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^-    INIBQDOCTION 

The  U.  S.  Government  enters  into  a  large  number  of 
contracts  with  the  private  sector  because  it  has  an  interest 
in  encouraging  private  action  to  accomplish  its  goals. 
Contracts  are  written,  agreed  to,  and  executed  with  the 
purpose  cf  fulfilling  the  needs  of  Government  agencies.  In 
doing  so,  however,  many  contracts  experience  cost  overruns 
because  of  imperfect  wording  of  contract  provisions,  tech- 
nical difficulties  experienced  by  contractors,  changes  in 
Government    cission   reguirements,    or   other   reasons. 

Cne  cause  of  cost  overruns  is  the  change  order — a  modi- 
fication issued  unilaterally  by  a  Government  contracting 
officer  directing  the  contractor  to  make  changes  within 
certain      regulatory    limits.  The     change      order    is      issued 

during  the  life  of  the  contract  and  usually  directs  certain 
actions  in  exchange  for  compensation  to  the  contractor.  Ihe 
intent  of  the  change  order  is  to  benefit  both  the  Government 
and  the  private  contractor  in  seeking  eguitable  solutions  to 
otherwise  untenable  situations.  The  change  order  is  consid- 
ered a  tool  of  the  Government  to  provide  flexibility  during 
contract  administration,  but  its  value  is  fully  realized 
only  when  used  with  restraint.  Contract  managers  sometimes 
permit  change  order  to  be  used  excessively,  especially  when 
they  make  liberal  or  lenient  interpretations  of  change  order 
regulations   and    policies. 

The  contractor  is  motivated  by  the  need  to  survive  and 
to  make  profits.  It  is  understandable  that  changes  to  a 
contract  would  be  priced  at  a  premium  if  the  prices  were 
solely  determined  by  the  contractor,  so  payments  for  changes 
are      negotiated      at      what   is      considered      to      be      "eguitable 


adjustment."!  Critics  of  Government  overspending  cite 
instances  of  wasteful  overruns  on  Government  contracts  as 
testimony  to  the  nismana gement  of  funds.  It  is  the 
Government's  duty  to  use  these  funds  strictly  for  the  public 
good.  Since  private  concerns  are  subordinate  to  the  public 
good,  the  Government  has  an  equal  interest  in  assuring  that 
private  individuals  to  not  benefit  at  its  expense. 

The  process  of  cost  overruns  may  be  exemplified  in 
Government  construction  contracting  by  significant  nuirbers 
of  change  orders.  Construction  contracting  is  uni>^ue 
because  virtually  every  facility  differs  from  others  in 
terms  of  function  and  description.  Whenever  a  new  and 
creative  architectural  concept  is  expressed  in  a  set  of 
drawings  and  specifications,  it  is  difficult  to  insure  that 
all  the  details  are  flawlessly  coordinated. 

This  thesis  will  analyze  problems  associated  with  change 
orders  for  construction  contracts  and  attempt  to  identify 
variables  that  significantly  affect  change  order  occurences. 
The  motivation  of  contractors  is  of  primary  concern  in 
determining  whether  they  have  been  successful  in  attaining 
profits  and  in  improving  their  positions  as  a  result  of 
overreliance  on  chances  to  contracts. 

Chapter  II  provides  a  background  for  the  concepts  of 
competitive  bidding  and  contract  change  orders.  A  perspec- 
tive of  the  bidding  contractor  is  taken  to  examine  his 
motives  and  strategies  prior  to  bidding.  Several  measures 
of  "level  cf  competitiveness"  are  introduced  from  bidding 
theory  literature  that  will  be  employed  in  the  analysis 
chapter  cf  this   thesis.    The  means  by   which  change  orders 


iThe  determinant  of  what  constitutes  an  "equitable 
adjustment"  has  never  been  objectively  qualified  or  quanti- 
fied. It  is  construed  in  the  ordinary  meaning  to  connote  a 
"fair,"  "reasonable,"  "just,"  or  "right"  arrangement  or 
settlement. 
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can  te  made  are  exanined.  The  general  hypothesis  of  this 
thesis  is  then  presented  after  the  reader  is  introduced  to 
these    concepts. 

Chapter  III  is  the  presentation  and  analysis  of  a  ir.odel 
constructed  of  actual  data  froni  one  of  the  Naval  Facilities 
Engineering   Command's    (NAVFAC)  Engineering    Field    Divisions 

(EFD)  .  Recently  awarded  construction  contracts  of  Western 
Division/  Naval  Facilities  Engineering  Command  (WESTDIV)  are 
analyzed  using  the  concepts  introduced  in  Chapter  II, 
Appendices  A  and  B  provide  a  description  and  listing  of  the 
variatles   used    for    the   analysis. 

Chapter  IV  summarizes  the  thesis  and  the  findings 
discovered  in  analysis.  In  addition,  some  general  conclu- 
sions are  made  which  are  either  supported  by  the  findings  or 
which    attempt      to   explain      inconclusive   results.  Finally, 

recommendations    for    future,    related    research    are    made. 


1  1 


II.     BACKGROOND 

A.       GZNEBAL 

1 .      Competitive    Eidding 

The  Department  of  Defense  (DOD)  is  the  largest 
contracting  agency  ir  the  federal  governmect/  with  aniiual 
awards  running  well  over  $100  billion  in  the  early  1980 's. 
By  the  end  of  the  decade  this  figure  is  likely  to  double. 
Congress  and  others  concerned  with  federal  spending  and 
accountability  have  paid  particularly  close  attention  to  DOD 
because  most  of  this  money  is  spent  noncompetit ively .  In 
Fiscal  Year  1981,  of  $105.2  billion  worth  of  prime 
contracts,  only  7.6  percent  of  this  money  was  involved  in 
competitively-awarded  contracts   [ Ref .     1:      p.    106], 

Ihis  concern  generated  the  creation  of  the  Office  of 
Federal  Erccurement  Policy  as  an  agency  to  prescribe  regula- 
tions and  policies  for  federal  procurement  that  would  fester 
Eore  competitive  pricing  [Ref-  1:  pp.  241-245].  The  Federal 
Budget  in  1982  projected  total  government  outlays  for  shore 
facility  construction  and  rehabilitation  in  excess  of  $30 
billion  [Ref.  2:  p.  1]-  The  Navy  Department's  share  of 
this  amount  was  approximately  $830  million. 2  The  Naval 
Facilities  Engineering  Command  (NAVFAC) ,  which  administers 
most  of  this  money,  traditionally  awards  its  construction 
contracts  on  a  competitive,  lump-sum  basis.  Competitive 
procurement   then,    is   a   consistent   practice   among    the    few. 


2The  Federal  Budget  projected  this  amount  for  Fiscal 
Year  1982  Navy  Department  Military  Construction  outlays. 
This  included  money  for  for  active  and  reserve  Navy  and 
Marine  Corps  components.  It  did  not  include  construction 
funded  from  other  sources,  such  as  Non-Appropriated  Funds, 
Defense  Faiiily  Housing,  and  Operations  and  Maintenance 
appropriations. 
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Competitive  tidding,  however  has  not  escaped  criti- 
cism. Fcrmer  General  Counsel  for  the  Department  of  the  Navy 
F.  Trowtridge  Vom  Baur  once  argued  during  a  Senate  hearing 
that  fierce  competition  is  not  in  DOD's  interest  because  it 
forces  contractors  to  offer  "tare  bones"  prices  that  could 
cause      them      to      go      cut   of      business.  As      a      result      the 

contractor,  Vom  Baur  stated,  is  forced  to  find  a  way  to 
recover  any  foregone  contingency  for  claims  after  the 
contract  is  awarded.  This  could  be  done  he  claimed,  as  a 
result  of  changes  desired  by  the  Government  during  the 
performance  of  the  contract  work.  Furthermore,  he  contended 
that  competitive  procurement  attracts  only  "marginal 
producers"  interested  in  low  profit  business.  Referring  to 
complex  systems  procurement,  he  explained  that  claims  would 
occur  more  often  when  contracts  are  competed  than  when  they 
are    negotiated.      [Eef-    3:      pp.    120-121] 

A  supporting  argument  is  that  the  competitive 
bidding  process  carries  with  it  a  heavy  financial  burden  on 
the  Government  and  spawns  some  ridiculous  practices, 
"Competitive  bidding  causes  government  to  be  a  bad  customer 
and,  therefore,  get  bad  treatment  from  the  vendor."  The 
contractor  is  obliged  to  cut  services  where  possible  and  act 
particularly  stingy  and  uncooperative  when  the  contractor 
learns  that  some  significant  feature  or  rec^uirement  was  left 
cut    of    the    original    contract    documents,       [Eef.    4] 

Ample  testimony  has  been  given  to  refute  the  criti- 
cisms of  competitive  bidding  [Eef.  5]-  Senator  Proxmire 
challenged  Vom  Baur's  statements  with  convincing  counte- 
rargument. Nevertheless,  a  competitively  bid,  fixed  price 
contract  imparts  more  risk  upon  a  contractor  than  any  other 
common  form  of  contractual  agreement.  The  "Changes"  clause 
in  Government  contracts  was  therefore  adopted  for  the  mutual 
benefit  of  the  contracting  officer  and  the  contractor 
[Eef,    6:    p.    38]- 
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2.  Ihe    "Changes"  Clause 

Ihe  concept  that  the  Government  should  have  the 
right  to  order  changes  to  the  work,  under  a  contract  has  been 
a  part  of  the  Governnent  contracting  process  for  years.  The 
"Changes"  clause  (see  Figure  2.1)  gives  the  Government  the 
flexibility  to  purchase  worx  or  effort  directly  froir  an 
existing  contractor  without  the  necessity  of  following  the 
statutes  which  rec;uire  procurement  pursuant  to  the  formal 
advertising  method.  Provided  a  change  is  "within  the 
general  scope  of  the  contract,"  a  Contracting  Officer  may 
bypass  a  great  deal  of  administrative  effort  by  negotiating 
the  cost  of  a  work  change  directly  with  the  original 
contractor. ^ 

The  "Changes"  clause  also  serves  a  useful  purpose  in 
allowing  contractors  a  means  of  initiating  changes  when 
errors  in  the  drawings  and  specifications  or  special  prob- 
lems in  site  conditions  are  encountered.  Some  Government 
officials  have  been  concerned  that  a  contractor  can  utilize 
this  clause  as  a  vehicle  for  inproving  his  position  under  a 
contract  where  a  loss  is  beiny  incurred  either  because  of  a 
substantial  underbid  or  a  variety  of  other  reasons.  The 
contractor  is  in  a  strong  bargaining  position  knowing  that 
there  will  be  no  price  competition.   [Ref.  6;  pp.  38-39] 

A  "Changed  Conditions"  clause   was  originally  incor- 
porated  into   the   Armed   Services   Procurement   Regulation 
(ASPfi)*    to   discourage   construction    contractors    from 


3A  change  prder  will  be  defined  herein  as  a  means  of 
ordering  variations,  changes,  and  additions  to  the  work 
under  contract  within  the  normal  authority  of  the  NAVFAC 
Engineering  Field  Division.  Tnerefore  Supplemental 
Agreements  and  change  orders  that,  when  added  to  existing 
change  orders  on  a  contract,  exceed  one  hundred  percent  of 
the  original  contract  price  shall  not  be  included.  Field 
EOICC's  are  not  authorized  by  NAVFAC  to  exceed  this 
percentage. 

*The  ASPR,  adopted  in  19U7^   was  replaced  by  the  Defense 
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STANDARD   FORM  23A  CONSTRUCTION  CONTRACT 
CHANGES  CLAUSE 


CHANGES    {  196.S   FED; 

(a)  The  Contractint;  Otrictr  may,  at  any  time,  without  notice  to  the 
sureties,  by  written  order  iicslt;natcd  or  indicated  to  be  a  change  order, 
make  any  chanpe  in  the  work  within  the  general  scope  of  the  contract, 
including  but  nor  limited  to  changes: 

(i)    in    the   specifications    (including   drawings   and    designs); 
(ii)    in  the  method  or  manner  of  performance  of  the  work; 
(iii)    in  the  Government-furnished   facilities,  equipment,  materials, 

services,  or   site;   or 
(iv)    directing  acceleration  in  the  performance  of  the  work. 

(b)  Any  other  written  order  or  an  oral  order  (which  terms  as  used 
in  this  paragraph  (b)  shall  include  direction,  instruction,  interpretation 
or  determination;  from  the  Contracting  Ot'ticer,  which  causes  any  such 
change,  shall  be  treated  as  a  change  order  under  this  clause,  proiidcd 
that  the  Contractor  gives  the  Contracting  Officer  written  notice  stating 
the  date,  circumstances,  and  source  of  the  order  and  that  the  Contractor 
regards  the  order  as  a  change  order. 

(c)  E.xcept  as  herein  provided,  no  order,  statement,  or  condua  of 
the  Contracting  OtTicer  shall  be  treated  as  a  change  under  this  clause 
or  entitle  the  Contractor   to  an   equitable  adjustment   hereunder. 

(d)  If  any  change  under  this  clause  causes  an  increase  or  decrease  in 
the  Contractor's  cost  of,  or  the  time  required  for,  the  performance  of 
any  part  of  the  work  under  this  contract,  whether  or  not  changed  by 
any  order,  an  equitable  adjustment  shall  be  made  and  the  contract  modi- 
fied in  writing  accordingly;  PrntideJ,  houcter,  That  except  for  claims 
based  on  defective  specifications,  no  claim  for  any  change  under  (b) 
above  shall  be  allowed  for  any  costs  incurred  more  than  20  days  before 
the  Contractor  gives  written  notice  as  therein  required:  And  pmitded 
further,  That  in  the  case  of  defective  specifications  for  which  the  Gov- 
ernment is  responsible,  the  equitable  adjustment  shall  include  any  in- 
creased cost  reasonably  incurred  by  the  Contractor  in  attempting  to 
comply  with  such  defective  specifications. 

(e)  If  the  Contractor  intends  to  assert  a  claim  for  an  equitable  ad- 
justment under  this  clause,  he  must,  within  30  days  after  receipt  of  a 
wrincn  change  order  under  (a)  above  or  the  furnishing  of  a  wrirten 
notice  untier  (b)  above,  submit  to  the  Contracting  Ofricer  a  written 
statement  setting  forth  the  general  narure  and  monetary  extent  of  such 
claim,  unless  this  period  is  extended  by  the  Government.  The  statement 
of  claim  hereunder  may  be  included  in  the  notice  under   (b)   above. 

(f;  No  claim  by  the  Contraaor  for  an  equitable  adjustment  here- 
under shall  be  allowed  if  asserted  after  final  payment  under  this  contraa. 


Pigure   2. 1        Construction  Contract   Changes   Clause, 
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includiLg  contingency  allowances  in  bids  for  additional  work 
possitly  experienced  in  handling  subsurface  materials.  It 
promised  an  equitable  adjustment  in  contract  price  for  addi- 
tional work  necessary  to  deal  with  unforeseen  conditions. 
It  could  he  employed  only  where  both  contractor  and 
Government  parties  labor  under  a  "mutual  mistake  of  fact" 
concerning  estimates  or  beliefs  involved.  Therefore,  it  was 
not  the  purpose  of  the  Changed  Conditions  Clause  to  protect 
a  contractor  from  his  own  errors  of  judgment  or  calcula- 
tions.  [Eef.  7:   p.  19] 

In  1968,  a  slightly  revised  clause  was  adopted 
dealing  with  "differing  site  conditions."  This  clause  is 
incorporated  into  the  General  Provisions  for  Construction 
Contracts.  In  effect,  this  clause  removes  some  risk  from 
the  Governiient  by  providing  for  an  adjustment  decreasing  the 
price  if  the  conditions  are  found  to  be  better  than 
expected.  "Differing  Site  Conditions"  replaced  the  former 
title  "Changed  Conditions"  in  the  Standard  Form  23-A 
(Contract  Provisions  for  Construction  Contracts)  to  describe 
more  accurately  the  subject  matter  of  the  clause.  [Eef-  8: 
p.  205] 

There  is  no  question  that  the  "Changes"  clause  has 
been  used  for  the  purpose  of  improving  the  contractor's 
position.  The  Government  has  several  ways  to  protect  itself 
in  this  situation.  The  most  common  is  to  require  adequate 
proof  of  claimed  increased  costs  [Eef-  6:  p.  39].  In 
general,  the  Goveriment  is  insulated  from  contract  price 
growth  by  explicit  federal  regulations  binding  contracting 
parties  and  policies  that  discourage  excessive  change 
orders. 


Acguisiton  Eegulation  (DAE) ,  which  has  since  been  consoli- 
dated into  ana  replaced  by  the  Federal  Acquisiton  Eegulation 
(FARi  .  The  provisions  for  Changed  Conditions,  stated 
withir,  are  still  applicable  as  10  U.S.C.   2301. 
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^  •   Change  Ord er  jBate 

Ihe  change  crder  rate  is  simply  the  percentage 
increase  (or  decrease)  in  contract  price  over  the  original 
award  amount  due  to  change  orders.  It  is  used  specifically 
in  this  research  to  assess  the  impact  of  price  changes  irre- 
spective of  contract  size.  It  has  the  advantage  of  placing 
all  contracts  under  a  normalized  measure  of  performance. 
Ihe  corresponding  disadvantage  is  that  a  given  change  crder 
rate  may  have  very  different  impacts  on  contracts  of 
contrasting  size.  This  raises  the  question  whether  the 
change  order  rate  is  a  useful  measure  for  assessing  the 
performance  of  contract  administration.  For  example,  a  ten 
percent  increase  in  contract  price  for  a  small  contract  may 
ie  the  result  of  one  rather  mundane  change.  A  ten  percent 
increase  for  a  large  contract,  however,  probably  is  the 
result  of  irore  complex  problems  for  the  contractor.  The 
amount  for  these  changes  could  involve  complex  construction 
methods  that  affect  ether  portions  of  work,  or  the  amount 
could  be  an  accumulation  of  many  minor  changes.  A  number  of 
small  changes  as  opposed  to  a  single  larger  one,  has  the 
tendency  to  spread  disruptive  effects  throughout  many  phases 
of  construction.  This  problem  has  been  the  subject  of 
claims  made  by  contractors  for  "impact"  costs  created  by  a 
"ripple  effect,"  where  a  change  disrupts  the  remainder  of 
the  contract  work  [Ref.  9:   p.  46]. 

Keeping  contract  change  orders  within  ccntrclled 
minimums  is  one  of  NAVFAC's  goals  [Ref.  10:  p.  C-109]-  Any 
realistic  limit  to  change  orders  must  be  expressed  as  a 
goal,  net  an  absolute.  Many  change  orders  are  valid  and 
prudent  tools  for  accomplishing  mission  objectives.  Ihey  are 
issued  for  various  reasons,  including  correcting  any  errors 
or  omissions  in  plans  and  specifications.  They  give  the 
Government  the  flexibility  to  make  convenient  adjustments  as 
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a  result  of  inevitable  errors^  oversights,  and  changes  in 
conditicns  or  requirements.  Yet  Government  agencies  have 
heen  accused  of  using  change  orders  excessively  [Ref.  11:  p. 
8].  Criticism  has  teen  focused  on  proper  or  sufficient 
actions    hy    Government  Contracting   Officers    to: 

•  Ensure  the  correctness  of  contract  documents  prior  to 
the    solicitation    of   the    invitation    for    bids. 

•  Screen    nonessential  customer-requested    change    orders. 

•  Settle  contract  change  order  prices  within  reasonable 
airounts  during  negotiations  with  contractors  [Ref.  2: 
pp.    9-14]. 

NAVFAC  communicates  specific  management  goals  for 
its  sutordinate  Engineering  Field  Divisions  (EFD's)  through 
annual  Command  Management  Plans  (CMP) .  In  many  cases,  goals 
are  specifically  tailored  for  each  EFD.  Under  the  Fiscal 
Year  1984  Construction  Program  of  the  CMP,  all  EFD's  are 
subject    to    the    same    criteria   for    change    orders: 

•  Keep  all  construction  type  change  orders  within  six  (6) 
percent  of  their  cumulative  current  year  contract  V'ork 
in  Places  (WIP)  while  maintaining  Military  Construction 
change    order   activity   at   five    (5)     percent. 

•  Keep  unforeseen  conditions  orders^  within  two  percent  of 
the   cumulative    current    year   construction   contract    WI?. 

•  Keep  design  change  orders''  within  1.5  percent  of  the 
cumulative  current  year  construction  contract  WIP. 
[Eef.    10:    p.    C-109] 


swork  in  Place  refers  to  the  dollar  value  of  work 
considered  to  be  constructed  in  place  by  a  contractor. 
Progress  payments  are  entitled  to  the  contractor  based  upon 
the    determination    of    this   value   by    the    EOICC. 

^CMS-coded  (see  Chapter  III. A.I)  change  orders  caused  as 
a  result  of  underground  obstructions,  changed  soil  condi- 
tions, unobserved  site  conditions  and  misstated  underground 
utility    locations. 

"'Change    orders    coded   for    design    errors    and   omissions. 

18 


Internal  controls  to  stea  the  aJDuses  criticized 
above  are  incoi porated        into  NAVFAC  directives. 

Prep  roc urement  actions  are  carefully  delineated  in  NAVFAC's 
Contracting  Manual  (P-68)  to  assure  comprehensive  review  of 
contract      documents    prior      to      award.  The    negotiation      of 

change  order  prices  requires  an  independent  Government  esti- 
mate to  re  used  as  the  basis  for  determining  a  reasonable 
settlement.  Customer-reg uested      change        orders      must      be 

limited  to  "in  scope"  changes  with  the  stipulation  that 
"desirability  of  the  change  and  the  fact  that  funds  may  be 
available  do  not  enter  into  determinations  of  scope" 
[Eef.  12:  p.  7-3.1.].  Before  the  construction  plans  and 
specifications  are  disseminated  to  prospective  contractors, 
there  are  three  stages  of  design  review.  The  first  two 
stages  are  reviews  by  NAVFAC  managers  to  insure  that  designs 
and  specifications  are  adequate  for  the  intended  ccnstruc- 
tion.  The  last  of  these  is  a  customer  review  to  ensure  that 
a  facility  will  meet  the  stated  functional  and  mission 
requirements  [Eef.     13:      p.    6]. 

E.       CCNTEACTOR    PIfiSPZCTIVE 
1 .      Eidding    Strategy 

Contractors,  over  the  long  run,  are  forced  to  bid 
low  enough  to  win,  yet  high  enough  to  cover  cost  and  make  a 
profit.  Successful   strategy      then,         as      depicted    in      bid 

theory,  is  to  bid  at  a  rate  above  cost  that  will  yield  the 
greatest  expected  value,  that  is,  the  net  of  probability  of 
winning  aultiplied  by  profit  margin.  As  profit  margins  are 
increased,  the  probability  of  winning  is  decreased.  As  a 
contractor  successively  increments  his  profit  margin  in  a 
bid,  he  increases  the  probability  that  he  will  exceed  the 
bid  of  one  of  his  coffipetitors--and  therefore  lose  the  award. 
Presumably,         an      optimal      profit   margin      exists      where      the 
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corresponding  probatility  cf  winniiig  an  award  yields  the 
greatest   ex^:ected   profit   [Bef.    14:      pp.    488-490]. 

The  contractor's  first  prerequisite  for  making 
profits  is  to  win  a  bid.  In  the  short  run,  a  contractor  may 
te  compelled  to  use  a  low  bid  strategy  that  virtually 
assures   his  chances    cf   winning.  The  amount   of    his    winning 

bid  can  seem  quite  illogical  to  other  competitors.  A  common 
occurrence  that  has  frustrated  many  contractors  is  that  many 
of  the  bids  submitted  on  all  types  of  projects  appear  to  be 
below  reasonable  costs.  In  one  particular  observance, 
nearly  80  percent  of  the  bids  on  ail  major  jobs  were  at  less 
than  the  engineer's  estimate, ^  some  even  at  less  than  half 
the  engineer's  estimate  [Eef-  15:  p.  127].  In  Government 
contracting,  the  mandatory  independent  estimate  of  project 
costs  is  an  average  cost  only.  In  contrast,  bids  of  rival 
firms  on  contracts  represent  opport  unity  costs  for  their 
resources.  Each  rival  firm  has  the  option  to  choose  these 
contracts  that  are  tie  most  advantageous  to  them  in  teres  of 
their  special  qualifications.  These  low  bids  are  indicative 
of      marginal     costs.  A        Government      estimate      cannot     be 

contractor  specific,  that  is,  representing  the  cost  of 
performing  a  particular  project  or  job  for  one  specific  firn 
[fief-    16:      p.    214]. 

It  is  advantageous  for  the  contractor  to  consider 
the  following  in  choosing  a  job  so  that  he  will  have  a 
likely    chance   of   winning: 

=^  •       Size.         Usually   the   larger    the    job,      tne  fewer   will   be 
the   number   of    competitors.  This   increases    the    prob- 

ability   of   winnirg.         Adversely,       the   larger    the    esti- 
mate,     the   greater   the   risk      that    the   estimate    will   be 


8The  independent  estimate  made  by  the  architect-engineer 
as  an  agent  of  the  cwner.  For  Government  contracting  the 
parallel   is    the    Goveinjnent    estimate. 
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inaccurate.  larger  construction  projects  tend  to 
involve  more  unconventional  construction  methods  and 
have  many  interrelated  activities.  Estimators  are 
more  i:rone  to  errors  and  oversights  in  determining  the 
costs  for  these  methods  or  activities.  Smaller  johs 
may  be  more  attractive  to  contractors  as  they  can  be 
the  foundation  for  invaluable  contacts  and  reputation 
for  later,  more  profitable  eventualities — a  form  of 
advertising. 

^-  Care  and  attention  required.  A  smaller  organization 
may  te  more  successful  in  performing  work  on  a  job 
that  requires  mere  attention  to  detail  than  could  be 
provided  by  a  large,  iigh-overhead  company. 

c-  Profit  advantage.  Several  jobs  concentrated  in  one 
locality  offer  inherent  advantages.  Economies  of 
scale  can  be  realized  for  labor,  materials,  and  super- 
vision. Improved  labor  relations  and  productivity, 
price  discounts  for  bulk  purchases,  and  improved 
time-saving  and  coverage  of  supervision  and  management 
result. 

^-  Continuity  of  employment .  Steady  employees  earn  their 
pay  more  productively.  Once  the  maximum  yearly 
contribution  to  the  Social  Security  tax  (FICA)  has 
been  made  by  the  contractor,  the  balance  stays  with 
the  contractor  as  a  distinct  accrual  to  his  job 
return. 

e.  labor  conditions.  Jurisdictional  disputes  may  involve 
a  contractor's  workforce  and  result  in  wage  increases. 

f.  Subcontracting .  The  reaction  and  bid  of  the  subcon- 
tractor can  be  important.  If  the  contractor  can  be 
assured  of  obtaining  low  subbids  from  reliable  sutccn- 
tractors,   he  will  have  a  good  chance  of  getting  prof- 

.  itable  work. 

V 
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9-       Figaiicial      solvency.  The    competitive      edge      may      be 

determined  by  the  ability  to  finance  construction 
between  progress  payments,  procure  construction  and 
payment  bonds,  and  take  advantage  of  trade  discounts 
for    prompt   payment. 

h.  Competition.  The  greater  the  number  of  competitors, 
the  lower  the  contract  price  must  be  to  win  the  award. 
A  decrease  in  price  below  a  certain  point  makes  oppor- 
tunities elsewhere  more  favorable,  [Eef.  17:  pp. 
81-86] 

i«  Seasonal  considerations.  Some  contractors  disregard 
overhead  and  equipment  costs  and  bid  low  upon  reaching 
a   certain    volume   of   work   during   an   operating    year. 

J-      Desperation.  When    a      contractor    is      in    a      financial 

position  where  money  is  urgently  needed  to  pay  bills, 
any  source,  including  jobs  at  a  loss,  can  prolong 
survival  in  business  [Ref.  15:  pp.  187-188].  When 
faced  with  a  choice  of  giving  up  his  capital  to  avoid 
going  deeply  into  debt,  a  contractor  will  assume  a 
great  amount  cf  risk  just  to  stay  in  business. 
[Ref.    18:    p.     154] 

There  is  an  intuitive  reason  to  suspect  that  a 
winning  bid  is  occasionally  submitted  by  a  poorly-informed, 
irresponsible  bidder.  The  poorly-informed  bidder  cannot 
expect  tc  make  a  positive  profit  since  his  bid  must  undercut 
an  amount  very  close  to  the  project's  "true  value"  in  order 
to  win.  The  "true  value"  is  a  theoretical  estimate  of  what 
the  project  should  cost,  after  all  biases  for  misjudgment  of 
costs,  unreasonable  contingency  amounts,  and  greed  are 
removed.  The  poorly-informed  bidder,  in  order  to  make  any 
profit  at  all,  must  bid  within  a  very  narrow  interval 
betweeen  this  "true  value"  and  the  maximum-informed  bidder's 
amount.       ■ More       likely,      his    winning      bid    will   be      below    the 
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"true  valu€."  This  phencmenon  is  referred  to  as  the 
"winner's  curse;"  the  individual  to  whom  a  contract  is 
awarded  tends  to  be  the  one  who  most  underestimated  the  true 
value  of  the  work  [Eef.  19:  p.  133].  In  higher-risk 
contracts,  the  Government  might  award  the  contract  to  a 
contractor  of  questionable  financial  stability,  tut  who 
cannot  be  classed  as  irresponsible.^  Reputable  contractors 
would  avoid  such  high-risk,  lump-sum  contracts,  because  they 
would  expect  to  be  underbid  by  contractors  who  fail  to  see 
risk    or    who   desire    such    risk   [Eef.    18;    p.     154]. 

All  contractors  must  face  risk.  Risk  includes  all 
exposures  to  loss  brought  about  by  nature,  organizational 
shortcomings  or  outside  influences.  Some  of  these  are:  (1) 
weather,  (2)  unexpected  job  conditions,  (3)  personnel  prob- 
lems, (4)  delays  in  caterial  deliveries,  (5)  labor  strikes, 
(6)  faulty  materials,  (7)  faulty  workmanship,  (8)  operating 
problems  (additional  expenditures  for  increased  supervision, 
damage  to  etjUipment  through  overloading  or  poor  mainte- 
nance),   and    (9)     natural    disaster. 

Successful  bidding  strategy  would  seem  to  involve  a 
careful  synergism  between  assumption  ox  risk  and  assessment 
of  competition.  A  misjudgment  of  the  former  is  likely  to 
result  in  a  disasterous  financial  consequence.  Misjudgment 
of    the   latter    will    likely   result   in   loss   of   the    award. 

2 .      Measuring   the  Intensity    of    Competition 

A  sharp  increase  in  construction  industry  unemploy- 
ment occurred  in  the  spring  of  1980  (see  Figure  2.2).  The 
industry  recession  prompted  contractors  to  be  much  more 
competitive  as  demonstrated  by  contractor  practices  in 
soliciting    business    en   a   national   rather    than    strictly    local 


^If   considered    a    "i;espo  nsitle"      bidder,       a  gontr^ctcr   is 
entitled   to    award   providea    he    is   also   a    responsive    bidder. 
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scale,  bidding  on  new  types  of  woek,  and  bidding  acre 
projects.  Officers  of  several  reputable  firms  lamented  that 
in  order  to  win,  profit  margins  in  bid  estimates  had  to  be 
cut    between   25    and    50   percent.      [Ref.    20:    p.    70] 
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Figure   2.2        Construction    Onemployment   Fiscal    Years    77-82- 

The  level  of  competition  for  a  particular  contract 
can  be  measured  in  at  least  three  ways.  First,  the  spread, 
or  difference  between  the  low  bid  and  the  second  low  bid, 
measures  the  amount  cf  money  "left  on  the  table"  and  indi- 
cates how  Euch  higher  the  low  bidder  could  have  been  and 
still  taken  the  award.  As  the  number  of  bidders  increases, 
the  percentage  spread  decreases  [Ref-  21:  p-  1382].  Second, 
the  ratio  of  the  winning  bid  to  the  Government  estimate  can 
be  used.  .  A  ratio  near  one  would  indicate  firms  bidding  near 
average      costs      while      a   lower      ratio      would      indicate      more 
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competitive   opportunity    costs    £Ref-    16:    p.    214].  The    third 

measure,      the      expected   number    of      bidders,       can  he    appxied 

where    it   is      necessary    to    decrement    one's      markup  margin    (in 

order  to  win)  as  more  competitors  respond  to  the  invitation 
for    bids   [Ref.     16:    p.   213]. 

Ihe  spread  can  be  normalized  for  contracts  of 
varying  sizes  by  expressing  it  as  a  percentage  of  difference 
tetween        the      lowest        and        second        lowest      bids.  Ihe 

bid-tc-Gcvernmen t  estimate  ratio  is  already  normalized  and 
the  number  of  bidders  does  not  appear  to  be  significantly 
related    to    the    size    ci   a   contract.      [Ref.     16:    p.    217] 

An  analysis  conducted  for  a  large  general  contractor 
illustrates  that  winning  bids  are  based  en  opportunity 
costs.  Over  a  two  year  period,  35  percent  of  all  competi- 
tors* bids  were  below  this  contractor's  estimated  direct 
"out      of      pocJcet"      costs      of      performing      the      work.  This 

contractor  was  still  able  to  compete  successfully  among 
other  reputable  firms,  and  his  estimates  closely  reflected 
his      actual   costs      of  operation.  Two-thirds      of    all      bids 

submitted  by  his  competitors  fell  between  91  and  120  percent 
of  his  direct  job  cost.  To  be  assured  a  50  percent  prob- 
ability of  winning  each  award,  the  contractor  would  have  had 
to  bid  belcw  construction  cost,  or  at  a  negative  profit. 
[Ref.    15:      pp.     127-128] 

^-       Contractor    Dislikes    for    Chang;e   Orders 

Many  contractors  contend  that  change  orders  are 
unprofitable  [Ref.    22;      p-       314].  They    complain    that    they 

require  great  effort  to  price  and  then  take  considerable 
time  to  get  approved  and  processed  [Ref.  23:  p.  8].  Ihe 
implementation  of  changes  results  in  a  dilution  of  top 
supervision  on  original  contract  work.  Too  much  time  of  key 
individuals  is  spent  arranging  for  changes  and  pricing  and 
negotiating    them   [Ref.    9:       p.    46]. 
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This  sentiment  may  partially  explain  why  complaints 
arise  frcni  the  Governnient  that  chanje  orders  are  priced  too 
highly  ty  ccntractors.  The  contractor  attempts  to  account 
for  unknown  costs  which  he  fears  may  occur,  while  Government 
estimators  may  have  an  unrealistic  understanding  of  actual 
costs  involved  in  certain  operations,  particularly  the  low 
productivity  of  direct  labor  as  a  result  of  changes,  delays, 
and  uncertainties  [Eef.  9;  p.  47].  Those  contractors  averse 
to  change  orders  should  be  logically  in  favor  of  contracts 
that  limit  the  amount  of  damages  entitled  to  the  contractor, 
some  contract  administrators  argue  [ Ref .  24:  pp.  97-98]- 
If  the  Government  is  lenient  in  permitting  compensation  to 
contractors  for  disputed  matters  where  liability  is  gues- 
tionatle,  then  disreputable  contractors  will  benefit.  Ihe 
disreputable  contractor,  who  relies  on  these  compensations, 
will  underbid  honest  contractors.  Limitation  of  liability 
clauses  in  a  contract  would  stem  the  practice  of  bidding  low 
and  seeking  to  recoup  losses  at  a  later  date  [Bef.  24: 
pp. 97-98]. 

The  additional  financial  burden  of  performing  change 
orders  may  be  unaffordable  to  the  contractor  who  is  in  a  low 
cash  position.  The  contractor  also  must  deal  frequently 
with  "cons tructi ve" 1 0  change  orders,  which  are  informal  tut 
have  the  effect  of  eroding  profits.  A  contractor  may  incur 
losses  on  a  contract  unknowingly,  suspecting  that  there  are 
deficiencies  in  his  accounting  system.  The  real  problem  may 
be  unidentified  constructive  change  orders  [Eef.  25:  pp. 
5-6  ]. 


lOAn  oral  or  written  act  or  omission  by  the  Contracting 
Officer  or  other  authorized  Government  official  which  is  of 
such  a  nature  that  it  is  construed  or  inferred  to  have  the 
same  effect  as  a  formal  written  change  order  under  the 
"Changes"  clause. 
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^-   Cod tractor  Preferences  for  Change  Orders 

Since  the  Government  reserves  the  right  to  issue 
"in-scope"  changes  to  the  provisions  of  a  contract,  the 
contractor  is  within  his  rights  to  demand  equitable  adjust- 
ments for  additional  costs  anticipated  in  associated  extra 
work.  If  a  change  reduces  the  amount  of  work  under 
contract,  the  Government,  too,  is  usually  entitled  to 
consideration  through  a  reduction  of  contract  price.  U .  S. 
Navy  contracts  ordinarily  permit  a  limit  of  six  percent 
profit  for  changes  negotiated  pursuant  to  the  "Changes" 
clause  [Eef.  12:  p.  7.3. U].  Ihe  claim  that  Government  esti- 
mators of  change  order  prices  have  been  too  reliant  upon 
contractor  estimates  during  negotiations  [Eef.  11:  p.  28], 
raises  the  question  whether  this  profit  limit  has  been 
frequently  circumvented.  Furthermore,  the  profit  that  might 
have  teen  realized  through  these  changes  may  have  been  of 
sufficient  aoaount  to  improve  many  contractors*  faltering 
financial  positions. 

Ihe  practice  of  trying  to  obtain  a  contract  award  by 
knowingly  offering  a  price  less  than  anticipated  costs,  with 
the  expectation  of  increasing  the  price  during  performance 
through  change  orders,  is  referred  to  as  "buying  in."  This 
is  generally  deemed  to  be  irrational  bidding  behavior  for 
contractors,  except  for  large,  multibillion-dollar  firms 
that  depend  upon  traditional  growth  in  defense  "state  of  the 
art"  programs  [Eef.  1:  p.  106].  But  "buying  in"  may  not 
seem  so  irrational  if  viewed  as  a  two-part  strategy.  Behind 
the  low  bid  could  be  a  "bail-out,"  or  contingent  escape 
strategy.  A  "bailout"  is  a  loophole  which  allows  the  bidder 
to  recoup  losses.  Ihe  "bail-out"  can  even  be  perpetrated 
with  the  help  of  the  Government  by .accepting  whatever  the 
contractor  can  deliver,  even  if  it  is  a  cheaper  or  substan- 
dard  product.    After   all,   it   is   reasoned,   the  'public 
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disclosure  that  a  very  low  bid  has  been  accepted  could  be 
ultimately  embarrass irg  to  Government  officials.  Either  a 
deductive  change  order  or  termination  of  contract,  which 
would  have  the  effect  of  minimizing  the  contractor's  losses, 
could  be  a  satisfactory  compromise  for  both  parties 
[Ref.    26:      pp.     84-87]. 

C.       THE    QUEST    FOB    PBCFIT    THRODGH    CHANGE    ORDERS 

The  potential  to  profit  from  any  change  order  depends 
upon  many  factors.  Among  the  most  prominent  of  these  is  the 
type  of  change  order.  The  Defense  Audit  Service,  in  a  1982 
audit  [Ref.  11:  p.  8],  attributed  73  percent  of  DOD  cnange 
orders  tc  three  causes.  Slightly  over  half  of  the  change 
orders  they  found  were  due  to  deficiencies  in  designs  and 
specifications;  ten  percent  resulted  because  specifications 
and  designs  had  not  been  completed  before  the  basic 
contracts  were  awarded;  and  about  eleven  percent  of  the 
change  orders  were  the  result  of  user  rec/uests  for  changes. 
Value  engineering  changes  were  not  cited  as  a  significant 
cause  of  change  orders,  but  they  are  very  attractive  for 
enhancing   ccntractor    profitability. 

1  •      Custom  er   Reguests 

It  is  difficult  to  predict  customer-reguested  change 
orders  since  they  are  implemented  either  in  response  to 
unpredicted  changes  in  mission  requirements,  or  in  as  a 
result  of  inadeguate  planning.  They  can  be  generated  as  a 
real  facility  need  or  as  a  compromise  or  exchange  for 
facility      features    no      longer      required.  It   has      been      an 

implicit      policy      of      NAVFAC    to      accomodate      the      customer's 
desires      for      such       changes    [Ref.    11:         p.  19].  If      the 

contractor    is   bound    by   a      set    of    explicit    specifications    and 
drawings,      the    custoEer- requested   change    order   may    be    one   of 
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the  final  avenues  for  opportunity  profits.  An  indicator  of 
contractor  motive  here  would  be  seen  by  suggestions  for 
changes  made  by  the  contractor  directly  to  the  facility 
user. 

2.      Ambiguities    of   Contract    Documents 

Ihe  most  overt  evidence  of  contractor  motive  to 
benefit  through  change  orders  has  been  seen  in  the  litiga- 
tion of  disputes  over  contract  documents.  Considerable 
legal  precedent  in  establishing  the  conditions  through  which 
a  contractor  may  benefit  from  contract  ambiguities  has 
evolved  in  the  courts.  A  number  of  landmark  cases  clearly 
shows  that  toth  Government  and  contractor  parties  cannot  use 
unilateral  interpretations  of  contract  language  to  benefit 
at  the  expense  of  each  other.  Since  the  majority  of  change 
orders  are  caused  by  mistakes  in  the  preparation  of  contract 
documents^  this  is  the  most  fertile  ground  for  seeking  extra 
compensation.  Ordinarily  the  contractor  relies  on  the 
implied  suitability  cf  Government  plans  and  specifications 
for  their  intended  use  [Eef-  27:  p.  1076].  But  a  contrac- 
tor's interpretation  of  contract  language  may  differ  from 
that  cf  the  Government's  due  to  some  degree  of  ambiguity 
caused  by  imperfect  wording/  conflicting  statements  or 
depictions,  or  connotated  meanings.  The  legal  system  has 
tested  many  cases  involving  contract  ambiguities  and  has, 
as  a  result,  produced  two  counterbalancing,  risk  allocation 
principles:  the  rule  of  contra  Eroferentum,  which  adopts 
the  interpretation  that  favors  the  non-drafting  party 
(contractor)  and  the  rule  of  pre-contract  clarification, 
which  denies  adoption  of  a  contractor's  interpretation  when 
he  has  failed  to  reguest  clarification  of  an  ambiguity  of 
which    he   knew    or   should    have   known   [Ref.    27:      pp.     SgS-SS^i]. 
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a.      Legal   Precedent    Favoring    the   Contractor 

Courts  have  generally  been  sympathetic  to 
contractors  when  inaccurate  or  incomplete  informaticr.  in  bid 
packages  result  in  urexpected  costs.  In  Peter  Kievit  Sonsj;_ 
Com£an_y  v.  United  States,  109  Ct ,  CI.  390  (1947),  the  Court 
of   Claims   held: 


Where  cne  of  the  parties  to  a  contract  draws  the  docu- 
ment and  uses  therein  language  which  is  susceptible  of 
more  than  one  meaning,  and  tne  intention  of  the  parties 
does  net  otherwise  appear,  that  meaning  will  be  given 
the  document  which  is  more  favorable  to  the  party  who 
did  not  draw  it.  Ihis  rule  is  especially  applicable  to 
Governirent  contracts  when  the  contractor  has  nothing  to 
say   as    to   its    provisions.       [Eef-    6:      pp.    231-232] 


In  WPC  Enterprises,  Inc.  v.  United  States,  16  3 
Ct.  CI.  1,  323  P. 2d  874  (1963),  and  Blount  Brothers 
Construction  Co.  v.  United  States,  17  1  Ct.  CI.  478,  346  F.2d 
962  (1965),  the  Courts  ruled  that  where  an  ambiguity  was 
"subtle,  not  blatant"  and  where  the  contractor  is  genuinely 
misled  and  not  deliberately  seeking  to  profit  from  a  recog- 
nized error  by  the  Government,  relief  is  entitled  to  the 
non-drafter  [Ref.  28:  p.  152]-  Furthermore,  in  Ghclscn, 
Byars  and  Holmes  Construction  Co.  v.  United  States,  17  3  Ct. 
CI.  374,  351  F.2d  987  (1965),  the  Court  ruled  that  there  is 
no  duty  to  seek  clarification  where  a  contractor  inrccently 
construes  a  subtle  ambiguity  in  his  favor.  Equally  impor- 
tant, if  clarification  is  not  provided  to  an  ambiguity 
sought  by  a  contractor,  the  Government  will  be  held  to  have 
waived  its  right  to  complain  of  the  interpretation  placed  on 
the    contract  by    the    contractor  [Eef-    29:      pp.     154-155]. 

Under  the  rule  of  pre-contract  clarification, 
the  contractor  is  obligated  to  inquire  about  major  patent 
discrepancies,         obvious   omissions      or      drastic   conflict      in 
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provisiop.s.  In    a      case   where      the      distinction    between      a 

patent  and  latent  aabiguity  was  an  issue,  the  Board  of 
Contract  Appeals  in  Worsham  Construction  Co.,  lll£- »  X« 
Ulliif^  States,  GSBCA  5469,  refused  the  Government  invocation 
of  the  "patent  ambiguity"  rule  as  a  means  of  preventing 
contractor  recovery  for  a  defective  specif icaticn. 
[Ref.    30:      pp.    9-10] 

t.       Legal  Precedent    Favoring    the    Government 

The  rule  cf  pre-contract  clarification  is  a  rule 
of  fair  dealing  which  protects  the  Government  from  a 
contractor  who  intentionally  submits  a  low  bid  with  the  goal 
of  claiming  ambiguities  during  contract  performance  to 
obtain      price  increases.  In   Beacon      Construction    Co.         v. 

United  States,  16  1  Ct.  Cl-  1,  314  F.2d  501  (1963),  the 
contractor  failed  to  notify  the  Government  of  an  ambiguity 
and      interpreted      the     contract      in      its      own     favor.  The 

contractor  sought  tc  recover  expenses  after  performing  the 
work  where  the  contract  language  was  vague.  The  Court 
denied  relief  to  the  contractor,  holding  that  such  a  claim 
was  made  without  pretest  and  in  absence  of  direction  from 
the  Government  [Ref.  6;  p.  234].  Where  a  conflict  in 
contract  documents  exists  and  is  known  to  the  contractor, 
relief  will  be  denied  tne  contractor  when  he  assumes  the 
right  to  disregard  the  affected  portions  and  apply  his  own 
remedy.  The  Court  stated  in  S.O.G.  of  Arkansas  v.  United 
States,  212  Ct  -  Cl .  125,  19  G.C.  (1976),  that  this  action  is 
taken  to  avoid  post-award  disputes  of  the  type  which  arose 
here  by  encouraging  contractors  to  seek  clarification  before 
anyone    is    legally   bound  [Ref.    31:      pp.    3-4]. 

The  pre-ccntract  clarification  rule  also  applies 
to  circunstances  where  a  reasonable  or  experienced  bidder 
should      be      capable    .of     recognizing      a      patent      or      glaring 
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discrepancy.  In  Wickham  Contracting  Co.  v.  United  States, 
212  Ct.  CI.  318,  546  F. 2d  395  (1976),  a  contractor 
submitted  a  bid  based  on  an  erroneous  drawing  scale.  The 
court  ruled  tJaat  the  use  of  the  erroneous  scale  was  so 
unusual  that  it  created  a  patent  discrepancy  [Ref-  27:  fp, 
1074-1078].  Siniiliarly,  in  J.  S.  Bajteson  Co.,  Inc.  v. 
115:41  ed  States,  GSBCA  1221;  E.  ^,  Hollingshead  Ccr_£.  v. 
United  States,  124  Ct.  Cl.  681,  683,  111  F.  Supp.  285,  286 
(1953);    and   others,    the   Courts    generally    agreed    that: 


An  experienced  contractor  cannot  rely  on  government- 
prepared  specifications  where.  on  the  basis  of  the 
government  furnished  data,  he  knows  or  should  have  known 
that  the  prepared  specifications  could  not  produce  the 
desired  result  for  '.  .  .  he  has  no  right  to  make  a 
useless  thing  and  charge  the  customer  for  it.'  rfief,  27: 
p.     1079] 


c.      Misrepresentation 

A  contractor  might  receive  relief  or  avoid  the 
commitment  to  a  contract  if  he  is  misled  by  a  false  repre- 
sentation or  nondisclosure  of  terms  in  the  bidding  package. 
Although  such  action  is  usually  not  indicative  of  a  contrac- 
tor's motive  to  gain  through  changes  to  a  contract,  it 
provides  recourse  for  a  low  bidder  to  escape  an  unprofitable 
dilemma.  A  Contracting  Officer  must  be  careful  that  he  is 
not  on  constructive  notice  of  an  error  where  a  mistake  in 
bid  is  alleged  after  award  of  contract.  If  a  low  bid  is 
significantly  lower  than  other  competing  bids  or  the 
Government  estimate,  the  contractor  may  avoid  commitment  to 
the  terms  of  the  contract  ordinarily  established  under  the 
firm    bid  rule^i      if    he   can    demonstrate      that    the    Contracting 


iiUnder  the  firm  bid  rule  in  Government  contracting,  the 
bidder  cannot,  in  the  absence  of  special  circumstances, 
withdraw    or   revise    a    bid   at    the   time    of    bid   opening. 
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Officer  had  "constructive  knowledge"  of  a  mistaken  bid. 
[Ref.    32:      pp-     152-153] 

^-      I^lJ^S   Engineering 

Value  Engineering  changes  are  unique  in  that  they 
tend  to  irairtain  the  essential  function  of  a  facility  while 
creating  cost  savings  for  both  the  Government  and  the 
contractor.  Provided  that  a  facility's  "essential  function" 
is  retained  intact,  a  Value  Engineering  change  will  deflate 
the  change  order  rate  and  increase  contractor  profitability. 
In  fixed-price  NAVFAC  contracts,  the  contractor's  share  of 
savings  is  determined  by  subtracting  Government  costs 
(resulting  from  developing  and  implementing  the  change)  from 
contract  savings  and  multiplying  the  result  by  55  percent. 
Ihe  Value  Engineering  provision  is  applicable  to  contract 
prices  of  $100,000  ci  more  £Eef.  33].  Obviously  it  is  an 
attractive  alternative  to  consider  for  the  change-minded 
contractor. 

E.       GENEEAL    HYPOTHESIS 

It  has  been  stated  that  contractors  are  compelled  in 
competitive  situations  to  bid  very  close  to  their  expected 
costs  cf  construction.  They  are  motivated  in  some  cases  to 
win  as  a  preferable  alternative  to  having  no  business  at 
all,      even      if    it      means  operating    at      a   loss.  Winners   of 

competitively-bid  contracts  are  either  those  who  enjoy  the 
relative  advantages  of  economies  of  scale  or  proprietary 
properties,      or      are    willing   risk-takers.  Risk-takers   are 

those  who  accept  the  probability  of  setbacks  in  the  course 
of    construction.  «ore   likely      they    probably      believe    that 

they  can  recoup  profits  later.  Although  there  are  many 
reasons  that  a  prudent  contractor  would  chose  tc  avoid 
change    orders,       they    are   nonetheless   inevitable.         It    is    the 
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premise  of  this  paper  that  there  is  a  link  between  the  cost 
of  change  orders  to  a  contract  and  the  degree  of  competi- 
tiveness under  which  that  contract  was  bid.  As  bidding 
competition  increases,  those  bidders  who  are  more  amenable 
to  the  risk  of  seemingly  unprofitable  ventures  and  are 
willing  to  gamble  on  change  order  dynamics  displace  the  more 
conservative  and  reputable  contractors. 

The  contractor  can  use  a  number  of  different  change 
order  types  to  his  benefit.  Among  these  are  customer- 
requested  changes,  changes  to  correct  mistakes  and  ambigui- 
ties in  contract  docunents,  changes  to  account  for  differing 
site  conditions,  and  Value  Engineering  changes.  Value 
Engineering  changes  have  been  shown  to  be  a  relatively  small 
proportion  of  federal  construction  contract  administration 
effort.  If  these  contractors  as  described  are  typically 
successful  bidders,  then  higher  change  order  rates  among 
contracts  that  are  bid  under  strong  competitive  conditions 
should  be  systematically  evident.  Empirical  data  will  be 
used  in  a  model  to  test  the  following  conclusions; 

•  A  direct  relationship  exists  between  change  order  rate 
and  degree  of  competition — measured  by  number  of 
bidders,  the  "spread,"  bid/Government  estimate  ratio, 
bid/mean  bid  ratio,  and  deviation  of  winning  bid  fiom 
mean  bid. 

•  Eelationships   exist   among  various   classifications   of 
construction  contract   change  order  rates   according  to: 
(1)  timing  of  the  contract  award,  (2)  contract  size,  (3) 
geographical   area,   (4)    type   of   facility,   and   (5) 
construction  industry  unemployment  rate- 
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III.  METHODOLOGY 

A.       DEVEIOPINS    THE    DilABASE 

1 .      General 

Ihe  data  for  the  research  were  collected  at  the 
Western  Division,  Naval  Facilities  Engineering  Command,  San 
Brunc,      California     (WZSTDIV).  Only    construction    contracts 

that  were  formally-advertised  and  fixed-price  are  included 
for  analysis.  These  contracts  were  WESTDIV  administered — 
that  is,  advertised  and  awarded  through  WESTDIV  or  its 
authorized  agents  at  WESTDIV-designa ted  geographical  loca- 
tions. Therefore,  construction  contracts  awarded  ty  local 
Of f icers-in-Charge  of  Construction  (OICC's)  of  more  limited 
contracting  authority  at  2  0  remote  "field"  offices  are  not 
included. 12    xhe    data    were  extracted   from    two    sources; 

•  The  Construction  Management  System  (CMS) ,  a  subsystem 
ccrtained  in  the  AMAL GAMAN/Integrated  Disbursing  and 
Accounting  Data  Ease  Master  maintained  by  the  Naval 
Facilities       Support      Office    (FACSO) ,  The      information 

provided  was  extracted  from  the  CMS  system  for  the 
author.  The  data  were  transcribed  from  computer  print- 
outs into  the  statistical  computer  program  to  be  used 
for    the   analysis    in    this   chapter. 


i^Navy  Civil  Engineer  Corps  officers  assigned  as  Public 
Works  Officers  at  Naval  activities  usually  are  assigned 
concurrently  (dual  authorities  are  vested  in  one  person)  as 
field  OICC's.  As  a  field  OICC,  contracting  authority  is 
more  limited  than  that  of  the  Commander  of  the  Engineering 
Field  Division  (WESTDIV).  Since  field  OICC  contract  bidding 
data  are  maintained  locally  at  these  remote  offices  ana 
their  collection  was  considered  infeasibie  within  the  time 
constraint    for    research,    they    are   excluded    from    analysis. 
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•  CcirpletGd  Scales  of  Bid  Offers  for  Construction 
Contracts  (12ND  WESTDIV  Form  4330/24)  maintained  by  the 
H€ad,  New  Procurement  Branch  (Code  02  1)  of  the 
Acquisition  Department.  This  information  was  provided 
by  hardcopy  listings  of  individual  contract  Government 
estimate   and  bid-opening   results. 

2-      ^ata  Set   Definition 

The      model    for      analysis    is      established    within      the 
following   considerations: 

•  Availability   of    bidding    information. 

•  Recentness    of   information. 

•  Consistency  in  management  policies  concerning  contract 
admiristration. 

•  Completion     (closecut)    of   contract. 

•  U.S.  Navy  funding  sources  (appropriated  and  non- 
appropriated)   only. 

Ihe    major      restriction    for    data    analysis       is    imposed 
by      availability      of      biddirg      information.  Although      CMS 

affords  the  opportunity  to  review  award  amounts  and  change 
order  information  for  contracts  of  all  appropriation  sources 
and  Engineering  Field  Divisions  of  NAVFAC,  the  extraction  of 
information  for  bidding  data  and  government  estimates^^  is 
cumbersome.  Accordingly,  only  WESTDIV  contracts  awarded 
from  Fiscal  Year  1978  to  the  present  have  been  included. i* 
This  does  afford  relative  currency  of  information.  Fiscal 
Year    1983    data    is   excluded,       however,       due    to    (1)       the    small 


i^Government  estimates  for  contracts  are  available  in 
another  subsystem  of  the  AMALGAMAN  Data  Base,  but  they  are 
not  tailored  as  necessary  to  reflect  the  actual  estimate  for 
the  base  bid  plus  or  minus  the  additive  or  deductive  bid 
items    that    actually    night   have    been    awarded. 

I'^Scales  of  Bid  Offers  are  maintained  at  WESTDIV  for  six 
years  until  disposal.  Coi ncidentally,  data  for  completed 
contracts  were  implemented  into  CHS  at  the  approximate 
starting   point    for    this   same   period    (1977) . 
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proportion  of  completed  contracts  available  and  (2)  revision 
of    WESTDIV    policies    in    (a)  "downloading"    many    contracts    to 

field  OICC's  (WESTDIV  was  authorized  increases  in  manpower 
levels  for  field  offices,  so  many  contracts,  especially 
C.Mi^-f und€d,    were   delegated    in    1983    to    OICC's    to    administer), 

(b)  accelerating  the  execution  of  ^^ESTDIV  contracts  award 
phase  and  (c)  encouraging  other  forms  ox  modifications  to 
contracts,    such    as    Supplemental   Agreements.         Items     (b)       and 

(c)  above  were  internalized  in  Fiscal  Year  1983  t^ESTDIV 
management    objective    plans. 

All  considered  contracts  must  have  been  "closed  out" 
or  completed,  so  that  the  change  order  rate  is  reflected  as 
a  final,  static  figure,  rather  than  a  dynamic  one  as  under  a 
contract-in-progress .  This  constraint  is  imposed  so  that 
all  influences  of  contract  price  expansion  during  the  life 
cycle    of    the  contracts   have    matured. 

Funding  sources        are  limited        to  Military 

Construction,       Navy     (I^CON)       and    Non-Appropriated    Funds     (NAF) 
contracts      in      excess     of        $200,000,         and      Operations      and 
Maintenance,    Navy    (OMN)     contracts    in    excess    of    $2500.         This 
constraint    is   arbitrary.  The   intent    is   to      view    the    inci- 

dence cf  construction  change  orders  under  one  service  branch 
(Navy),  so  that  as  much  consistency  in  the  attitudes  and 
policies  of  making  change  orders  could  be  ensured.  This 
would  avoid  any  possible  biases  by  NAVFAC  managers.  The 
$200,000  floor  on  MCCN  and  NAF  contracts  reduces  the  size  of 
this  study's  data  base  to  a  workable^s  number  and  eliiiiinates 
many      mixed-funding      source         contracts. i^      These      contracts 


i^Initially  it  was  estimated  that  inclusion  cf  many 
smaller  MCON  contracts  would  overload  the  storage  capacity 
of  the  MINITAB  computing  system  used  for  statistical  anal- 
ysis. 

i^Many  construction  contracts  are  funded  by  a  mix  of 
more  than  one  source —  for  example,  MCON  and  OMN  dollars  are 
commonly   used      under    one      contract    for      building    alterations 
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represent  a  relatively  small  proportion  of  tLe  total  amount 
of  "-ICCN  and  OMN  funds  administered  by  NAVFAC  and  therefore 
should  net  significantly  bias  the  results  of  analysis. 

3  •   Eg fining  the  Data 

The  data  considered  within  the  above  constraints 
possess  a  number  of  clear  outliers  that,  if  included  in  the 
analysis,  would  distort  overall  values  for  change  order 
pricing  and  bid  averages.  The  following  types  of  WESTDIV 
contracts  are  further  excluded: 

•  Contracts  terminated  early,  where  the  majority  of 
construction  dollars  are  not  consumed  or  "in  place." 
Otherwise  the  change  order  rate  would  appear  as  a  large 
deductive  (negative)  one.  A  small  number  of  contracts 
are  terminated  for  convenience  of  the  Government  if  the 
facility  or  some  of  its  features  are  no  longer  re-juired. 
A  contract  may  also  be  terminated  for  default  when  the 
contractor  fails  to  make  satisfactory  progress  in 
construction  or  breaches  the  terms  of  the  contract. 

•  Contracts  for  which  costs  listed  in  CMS  do  not  account 
for  the  majority  of  the  award  amount.  Presumably,  ether 
phases  of  construction  had  not  yet  been  reported  as 
completed  or  consisted  of  work  funded  under  a  separate, 
unreported  source. 

•  Construction  contracts  for  Adak,  Alaska,  under  WZSTEIV's 
cognizance;  these  contracts  suffer  from  restrictive 
competition  and  unique  logistics  at  an  isolated 
location. 

A  total  of  473  completed  i^lCON,  NAF ,  and  CMH 
construction  contracts  awarded  from  October  1977  through 
September  1982   were  listed   on  the  CMS   printouts  as   of  15 


(MCON)  and  repairs  (Cf^N)   when  the  construction  features  for 
each  fundirg  source  are  clearly  separated. 
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February    1984.  Of    these    U7      were    deleted    for      the    reasons 

stated  above.  Another  126  contracts  for  Fiscal  Years  1980 
and  1981  were  excluded  because  their  corresponding  Scales  of 
Bids  were  not  available.  There  remained  300  contracts  for 
analysis.  Table    I      summarizes    the      distribution    of      these 

contracts. 

TABLE    I 
Summary    of  Distribution   for   Database   Contracts 


FISCAL 
"1111" 

NUMBER  CF 
CUWT11CT3 

TOTAL 
■   (i2 

DOLLAE 

Mil 

YEAR  TOTAL 
lin~$T0'(7ar 

CMN 

MCON 

NAF 

OMN 

MCON 

NAF 

1978 

6 

43 

4 

$  868 

7211  1 

2453 

$  75432 

1979 

28 

76 

6 

6295 

142980 

5008 

154283 

1980 

14 

14 

2 

5741 

31S17 

688 

38246 

1981 

1 

12 

** 

^ 

255 

17645 

56  9 

16469 

1982 

60 

28 

4 

14932 

30279 

1713 

46  924 

TOTAL 

109 

173 

18 

28091 

294832 

1043  1 

$  333354 

4 .       Summarization  and   A ssum£tions 

Appendix  A  describes  the  variables  provided  for  each 
WESTDIV  contract  by  the  Construction  Management  System  and 
the    Scales    of    Bids.       Appendix    B   tabulates    these    data. 
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a.   Assumpticrs 

C)  Geographical  Categorization..  To  isolate 
the  effects  of  geographical  differences  in  climate,  economy/ 
employment  rate,  and  ether  factors,  the  contracts  are  clas- 
sified among  eight  general  categories.  Four  of  these 
pertain  to  major  U.  S.  Naval  activity  concentrations,  while 
the  ether  four  are  classified  as  "rural"  areas  in  the 
outlying  vicinity  of  these  concentrations.  Generally  these 
"rural"  activities  lie  more  than  50  miles  or  convenient 
commuting  distance  from  San  Diego,  Los  Angeles,  San 
Francisco  or  Sea ttle/Eremer ton. 

(2)  Numter  of  Bids.  It  is  apparent  that  some 
hids  appearing  on  the  Scales  of  Bids  were  disproportionately 
high  as  compared  to  either  other  competitors  or  the 
Government  estimate.  These  bids  would  only  distort  values 
(such  as  standard  deviation  and  mean  bid)  calculated  for 
analysis  [Eef.  21:  pp.  1377-1378].  These  are  considered 
nonserious  or  "noise"  bids  and  are  typically  excluded  in 
studies  of  auctions  and  bidding  models  [Ref.  19:  p.  126]. 
An  appropriate  algorithm  for  identifying  these  bids  depends 
upon  the  model,  and  there  appears  to  be  no  definite  rule  for 
determining  them.  Therefore,  any  bid  greater  than  150 
percent  of  the  competitive  mean  bid  was  arbitrarily  consid- 
ered a  "noise"  bid  by  the  author  and  was  extracted.  This 
adjustment  was  made  to  54  bids  on  43  contracts.  It  was 
observed  that  some  bidders  consistently  submitted  "noise" 
bids.  Comnon  reasons  for  unreasonably  high  bid  prices  may 
fall  into  one  or  more  of  the  following  categories  [Eef.  34: 
p.  127]  : 

•  Complementary  bidding.  The  bidder  is  not  interested  in 
performing  the  subject  work,  yet  does  not  want  to  be 
otherwise  prevented  from  bidding  on  future  projects  or 
to  be  deleted  from  future  Bidder's  Lists.    The  proposed 
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price    is     inflated   to   a      range    that    will     prevent    likely 
award. 

•  Bidder  error.  Mistakes  simply  may  be  made  when  calcu- 
lating   tid    prices. 

•  Bidder    ffiisunderstanding    of   the   scope   of    the    work. 

•  Perceived  risk  on  the  part  of  the  bidder.  Any  number  of 
factors  may  cause  the  bidder  to  perceive  real  or  imagi- 
nary areas  of  risk  and  to  raise  his  bid  price  to  provide 
for    this  risk. 

•  Ihe  bidder  may  be  quite  uncertain  about  the  proposed 
work,  the  Govercment' s  particular  requirements  of  the 
contractor,    or    his   ability   to   perform   as    expected. 

(3 )  Next  Lowest  Bidde r^s  Price  an d  Spread . 
The  next  lowest  bidder's  price  and  the  spread  are  included 
for  analysis  to  examine  any  significant  relationships 
between  change  order  rate  and  intensity  of  competition. 
Chapter  II. E. 2.  cites  the  significance  of  these  data  in  bid 
analysis. 

(4)  The  Number  of  Chancj_e  Orders.  The  number 
per  contract  of  dollar- valued  change  orders  is  analyzed  to 
determine  the  effect  it  has  on  the  change  order  rate.  Some 
change  orders  are  "no-cost"  and  do  not  directly  affect  the 
change  order  rate.  Among  the  dollar-valued  change  orders 
are  amounts  either  added  to,  or  deducted  from,  the  contract 
price.  This  variable  is  of  no  value  for  predictive 
purposes,  it  is  noted,  since  it  cannot  be  known  at  the  time 
of   bid   opening, 

(5)  Low  Bid/Mean  Bid  Deviation.  The  deviation 
of  the  low  bid  from  the  mean  bid  can  be  expressed  as  a 
measure  of  the  number  of  standard  deviations  that  lie 
between  the  low  bid  and  mean  bid  on  a  given  contract.  It 
conveniently  normalizes  all  contracts  regardless  of  award 
amount.      A    comparatively   high    value   here    is   an  indication    of 
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an  unusually  deviant  tid.  But  the  value  of  a  standard  devi- 
ation is  diminished  for  very  small  population  sizes,  so  this 
measure  is  used  only  en  contracts  where  there  were  at  least 
four  bidders.  Analysis  is  focused  on  the  determination  of 
any  relationships  between  this  value  and  the  change  order 
rate. 

(6)  "Equivalent"  Change  Order  Rai^«  ^ 
contract  change  order  is  fre^^uently  intended  as  a  means  of 
correcting  a  deficiency  or  mistake  or  maKing  an  "ir  scope" 
change  that  is  more  accomodating  to  the  facility  user. 
Frequently,  a  specific  feature  of  a  final  facility  after 
change  orders  is  not  that  which  was  originally  intended  at 
the  award  of  contract.  In  many  cases,  some  facility 
features  are  no  longer  needed  or  are  substituted  by  an 
equivalent  "in-scope"  alternative.  These  changes  do  not 
alter  the  function  of  the  facility,  but  they  do  alter  the 
contract  price,  and  usually  at  a  lower  cost.  Adding  the 
amount  of  deductive  change  orders  back  into  the  contract 
price  reflects  more  accurately  what  the  contract  would  have 
cost  if  the  original  features  were  left  intact.  While  this 
is  not  necessarily  an  accurate  assumption  for  all  deductive 
change  order  situaticns,  it  is  believed  to  provide  a  more 
conservative  comparison  of  contracts  in  the  context  of 
"dollar's  worth"  of  construction.  J^alue  engineering  change 
orders  are  not  added  back  into  the  contract  price,  because 
this  kind  of  change  order  actually  reduces  the  contract 
price  without  "impairing  essential  functions  or  characteris- 
tics." The  basic  criterion  for  deducting  the  "equivalent" 
change  crder,  as  contrasted  with  leaving  the  Value 
Engineering  change  crder  intact,  is  in  the  consideration 
given  to  the  Sovernment.  In  the  "equivalent"  change  crder, 
the  Government  gets  a  reduction  in  the  contract  price, 
because  it  is  buying  something  less  in  value  than  originally 
intended. 
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(7)  Eiii^lilil  3id  to  Average  Bid  Ratio.  This 
value,  usually  less  than  unity  (unless  there  is  only  one 
bidder)/  compares  the  relative  difference  between  the 
winning  tid  and  the  competitive  average.  The  "competitive 
average"  excludes  the  winning  tid  in  its  computation  and  is 
assumed  to  te  a  more  realistic  approximation  of  a  construc- 
tion project's  "true"  or  market  price.  Therefore,  a  low 
ratio  would  imply  that  a  winning  bid  is  priced  far  below 
expected  costs,  and  is  prone  to  being  a  "buy-in"  or  a  poten- 
tially  losing   venture  for   the   contractor. 

(8)  Winning  Bid  to  Government  Estimate  Eat io. 
The  use  of  this  ratio  for  analysis  assumes  that  the  indepen- 
dent Government  estimate,  also  referred  to  as  the  "engi- 
neer's estimate,"  is  a  fair  price  for  the  contract.  The 
relationship  of  change  order  rates  to  this  ratio  is  another 
focus   of   analysis. 

t.      Eesearch   limitations 

The  availability  of  Scales  of  Bids  and  a  source 
for  reliable  Government  estimates  is  clearly  the  most 
limiting  factor  of  this  research.  A  reliable  classification 
code  for  the  type  of  construction  performed  under  each 
contract   was     extremely    limited.  It   is      acknowledged   that 

certain  types  of  construction,  such  as  placement  of  under- 
ground utilities,  are  inherently  risky.  Many  projects 
involve  an  aggregation  of  various  construction  trade  disci- 
plines, so  it  is  difficult  to  make  a  single,  inclusive  clas- 
sification for  a  contract,  NAVTAC  Facility  Category  Codes 
[Eef-  35]  are  available  in  CHS  for  Military  Construction 
contracts  only.  However,  Facility  Category  Codes  categorize 
contracts  according  to  facility  type  rather  than  construc- 
tion type.  Table  II  summarizes  the  distribution  of  Military 
Construction  contracts  contained  in  the  database  according 
to    Category   Code. 
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TABLZ    II 
MCON    Contracts  by   Category   Code 

Facility    Categci^  liMk§£   21.   Contracts 

Operational    (excl.    Waterfront)  21 

Waterfront  10 

Training  19 

Mainteiance  33 

Production  1 
Supply                                                                                                 '          12 

Hospital,    Medical   and   Dental  7 

Administration  8 

Unaccompanied  Personnel   Housing  9 

Community  3 

Utilities   and  Ground    Improvements  43 


Total   Military    Construction    Contracts 

in    Database  173 


c.      Other   Data 

For  informational  purposes.  Figures  2.2  and  3.1 
show  the  trends  in  various  measures  of  construction  industry 
inflation  and  unemployment  over  Fiscal  Years  1977  to  1982. 
This  information  is  extracted  from  periodical  issues  of 
Engineering-News   fiecord     (EN E) . 

C)       Construction      Industry    Inflation.  Figure 

3.1  plots  ENR ' s  Construction  Cost  Index  (CCI)  for  three 
major  geographical  areas  pertinent  to  the  database 
contracts.  The  CCI  is  a  measure  of  the  combined  effect  of 
wage  and  material  price  changes  on  the  value  of  the 
construction  dollar.  The  year  1967  was  established  as  the 
base    for      an  index       value   of    100.  Tnis    index      is    computed 

monthly   by    ENR    for    twenty   major    U.S.    metropolitan    areas. 
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(2)  Lfneir.ploYnie  nt  Hate.  This  rate  is  deter- 
miaed  quarterly  by  ZNR  and  is  expressed  as  a  national 
average;       no   geographical   distinctions   are    made. 

(3)  Small  Business  Set-Asides.  NAVPAC 
requires  that  all  construction  procurement  in  excess  of 
J2500  and  under  $1,000,000  shall  be  considered  for  Small 
Business  Administration  (S3A)  set-asides  [Ref.  12:  p. 
4.2.13].  A  small  business  set-aside  is  a  procurement  that 
is  eligible  only  for  award  to  an  SBA-certif led  contractor. 
Set-asides  were  created  to  encourage  more  commerce  among 
small,  entreprenurial  firms.  Approximately  95  percent  of 
the  database  contracts  are  set-asides.  The  awarding  of 
set-asides    has    drawn   some  concern: 


A  dilemma  to  the  Government  posed  by  set-asides  is  that 
in  the  short  run,  prices  may  be  higher  and  competition 
restricted  as  small  businesses  incur  high  start-up  costs 
and  are  unable  to  take  advanta-j-e  of  economies  or  scale 
to  lessen  costs.  In  the  long  run,  however,  the  set- 
aside  program  enlarges  the  total  number  of  contractors 
available  to  compete,  and  it  should  thereby  contribute 
to    lower   contract    bids.      [Ref.    37:      p.    21] 


B.       ANALYTICAL    COMPOTATIONS 

The  data  were  compiled  for  analysis  on  the  IBM  3033A? 
Computer  at  the  Naval  Postgraduate  School,  Monterey, 
California.  The       general      purpose      statistical      computing 

system,  Minitab  [Ref.  36],  was  used  to  perform  various 
computational  functions  for  data  organization  and  analysis. 
The    functions   included: 

•  Sorting,   rank-ordering,    and   receding    of    data. 

•  Mathematical  calculations    (averages,         totals,       standard 
deviations,    etc.). 

•  Histogram  and    plot   construction, 

•  Regression    analysis. 

•  Analysis  of    variance. 
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!•   Sorting,,  Pan j^-crder  iiig  t    and  Recoding  of  Data 

These  features  of  Minitab  are  useful  in  examining 
ranges  of  values,  treakin g  data  into  cells  for  variance 
analysis,  and  isolating  selected  independent  variables  for 
more  detailed  analysis.  Variance  and  regression  analyses 
can  b€  performed  conveniently  for  selected  geographical 
areas,  time  frames,  dollar  ranges,  facility  types,  and  many 
other  desired  classifications. 

2.  Mathematical    Calculations 

Minitab  enables  simple  calculations  of  averages, 
totals  and  standard  deviations  of  various  data  diversifica- 
tions. Much  of  the  summary  data  represented  in  this  study 
are  the  result  of  these  calculations. 

3.  fiistoqram  and  Plot  Construction 


Ihis  feature  provides  convenient  display  of  data 
distributions.  Figure  3.2  displays  the  skewed  distributions 
ox  change  order  rates  for  the  database  contracts.  Plots 
afford  graphical  displays  of  of  relationships  among  vari- 
ables. They  are  used,  if  necessary,  in  analysis  of  regres- 
sion residuals  to  check  the  validity  of  the  assumptions  of 
normality  and  constant  variance  of  the  residuals.  Plots  are 
useful  in  visually  displaying  the  degree  of  correlation 
between  two  variables. 
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y  .       Beqressicn    A ral^si s 

Eegression  analysis  is  a  useful  tool  for  determining 
relationships  between  a  dependent  variable  and  any  number  of 
independent  variables.  The  change  order  rate,  as  a  depen- 
dent variable,  is  examined  for  any  significant  relationship 
to  a  number  of  independent  variables,  such  as  number  of 
bidders,    the  "spread,"   and    bid-to-Government    estimate    ratio. 

5 .       Analysis   of    Variance 

Through  the  use  of  analysis  of  variance,  significant 
differences  among  txc  or  more  populations  of  data  can  be 
tested.  A  statistical  investigation  can  be  made  into  the 
comparison  of  chance  order  rates,  for  example,  among 
different  classifications  of  geographical  areas,  award 
periods,    and  bid-estinate  ratios. 

C.        IINDINGS   OF    ANALYSIS 

1 .      Dependent   Variables 

The  objective  of  this  analysis  is  to  determine  any 
significant  relationships  through  regression  and  variance 
analyses  between  change  order  rates  and  other  variables 
available  in  the  database.  Two  independent  variables  are 
considered:  the  actual  change  order  rate  and  the  "eguiva- 
lent"  change  order  rate — a  refined  figure  with  the  dampening 
effect   of   deductive    change    orders   removed. 

2  •      Independent    Variabl es 

The  following  are  used  as  independent  variables  for 
regression    analysis: 

•  Number    of    Change    Crders. 

•  Number    of    Bids. 
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Actual  Chan£e   Order   Rate 

■Eacli  "?  represents  "2   oFservations 

Middle  of        Number  of 
Interval  Observations 

0.00  minus    2  * 

-2.00  7  **** 

2*00  43  ********************** 

4*00  40  ******************** 

6*00  34  ***************** 

8.00  24  ************ 

10.00  16  ******** 

12.00  14  ******* 

14.00  8  **** 

16.00  3  ** 

18.00  4  ** 

20.00  6  *** 

22.00  5  *** 

24.00  3  ♦* 

26.00  4  ** 

28.00  4  ** 

30.00  0 

32.00  2  * 

34.00  1  ♦ 

36.00  3  ** 

38.00  1  * 

40.00  plus       5  *** 


Ecjuivalent  Change    Order    Rate 
EacH  "^   represents    z   o^ervalions 

Middle   of  Number  of 

Interval  Observations 

-2.00    minus    1  * 

0,00  72  ************************************ 

2.00  42  ********************* 

4,00  40  ******************** 

6.00  35  ****************** 

8.00  24  ************ 

10.00  18  ********* 

12.00  14  ******* 

14.00  8  **** 

16.00  3  ** 

18.00  4  *♦ 

20.00  5  *** 

22.00  6  *** 

24.00  4  ** 

26.00  3  ** 

28.00  6  *** 

30.00  1  * 

32.00  2  * 

34.00  1  ♦ 

36.00  3  ** 

38.00  1  * 

40.00    plus  7  **** 


Figure   3.2        Histograms   of   Change   Order  Rates, 
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•  Number  of  Standard  Deviations  Between  the  Low  Bid  and 
the    Mean  Bid. 

•  Winning   Bid    to    Mean    Bid    Eatio. 

•  Winning    Bid    to    Government    Estimate    Ratio. 

•  Percent  Spread  Between  the  Low  Bid  and  the  Next  Lowest 
Bid. 

Subpopulations  of  the  following  variables  were  used 
for  exaiiining  significant  differences  among  change  order 
rates    through   variance   analysis: 

•  Award  Date  Periods,  by  fiscal  year  and  by  fiscal 
quarter . 

•  Award  Amount,  in  stepped  ranges  of  various  dollar  amount 
intervals. 

•  Geographical  Area,  by  each  of  the  eight  categories,  and 
then   into   two  categories — "metropolitan"    versus    "rural." 

•  Funding  source,  in  three  celis--Mili tary  Construction, 
Ncn-appropriated    Funds,    and   Operations   and   Maintenance. 

•  Number  of  Bids,  in  various  cells  ranging  from  ore  to  24 
lids   per  contract- 

•  Winning  Bid  to  Mean  Bid  Ratio,  classified  into  10  cells 
of    approximate    egual   size: 

0.00  -  0.70 

0.70  -  0.78 

0.78  -  0.82 

0.82  -  0.85 

0.85  -  0,88 

•  Winning  Bid  to  Government  Estimate  Eatio,  classified 
into  ten  cells  for  all  300  contracts;  and  seven  cells 
for  the  173  MCON  contracts: 

300  Contracts       J_73  MCON  Contracts 

0.00  -  0.65 

0.65  -  C.76 

0.76  -  C.84 

0.84  -  0.90 

0.90  -  0.97 

0.97  -  1.03 

1.03-1,10  1.20  plus. 

1.  10  -  1.19 

1,  19  -  1,30 

1.30  plus 
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0,  88    - 

0,91 

0.91    - 

0,93 

0.93    - 

0.95 

0.95    - 

0.97 

0.97    - 

1.00 

0.  00    - 

0,80 

0,30    - 

0.90 

0.90    - 

0,97 

0.97    - 

1.03 

1,03    - 

1.10 

1.  10    - 

1,20 

•  Uneaploymeiit  Rate-  classified  into  13  cells  representing 
apprcximate  construction  industry  unemployment  rates 
ranging   from    9.0    to    18.5   percent    over    20    quarters. 

^  •      freliminary.    finding  s 

a.      Change   Order   Rates 

The  chance  order  rates  for  the  data  are  shovn  in 
Table  III.  These  rates  are  higher  than  the  WESTDIV  stan- 
dards  of   six      percent   overall   and   five      percent    for    Military 


TABLE    III 
Change   Order   Bate   Summary 

Average  Change  Actual  Equivalent 

Order  Rate  (percent)  (percent) 

MCON  7.83  8.43 

CMN  7.53  8.41 

NAF  6.19  6.23 

OVERALL  7.62  8.29 

Construction  contracts.  The    WESTDIV    standards      are    predi- 

cated upcn  the  annual  Work  in  Place,  however,  and  do  not 
account  necessarily  for  all  change  orders  to  a  given 
contract.  The      figures      above      are      representative      cf      a 

slightly  different  criterion,  that  is,  the  total  change 
orders  for  each  contract,  including  settlements  tc  claims 
that  may  have  lingered  over  a  substantial  period  of  the 
contract  life.  WESTDIV  has  been  more  successful  in  control- 
ling the  overall  change  order  rate  than  it  has  the  .^CON 
change  order  rate.  The  Command  i'lanagement  Plan  standards 
mentioned  in  Chapter  II  are  high.  The  change  order  rates  in 
Table  III,  it  is  recalled,  were  adjusted  to  eliminate 
deviant  values.  To  make  a  more  fair  comparison  between  the 
performances  of    CMP-tased   change    order      rates    and    the    change 
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crder  rates  determined  in  this  analysis,  a  number  cf  factors 
would  have  to  he  considered  in  crder  to  put  them  on  an  even 
plane.  Such  factors  include  the  percentage  of  Work  in  Place 
contracts  actually  ccapleted,  and  the  average  incidence  rate 
of  change  orders  toward  the  end  of  the  contract  life. 

h.   Number  of  Bids  Affecting  tne  "Spread" 

Park  [Ref.  15]  asserts  that  the  percentage 
spread  decreases  as  the  number  of  bidders  increases.  The 
evidence  for  this  in  this  analysis  is  weak.  The  only 
significant  1"'  difference  in  the  spread  is  between  the  group 
cf  3  to  5  bidders  and  the  group  of  6  or  more  bidders.  The 
mean  spread  for  the   group  of  3  to  5  bidders   in  the  data  is 

13.2  percent,   with   a  confidence  interval  between   10,1  and 

16. 3  percent.  The  mean  "spread"  for  the  group  of  6  or  more 
bidders  is6.9  percent,  with  a  confidence  interval  between 
U.4  and  9.4  percent.  These  findings  are  based  on  only  169 
contract  observations,  as  the  "spread"  was  not  calculated 
for  contracts  where  there  were  three  bidders  or  less. 

^  •   Findings  of  Regression  Analysis 

A  series  of  stepwise  regressions  were  performed  on 
each  of  the  dependent  variables  against  all  considered  inde- 
pendent variables.  No  single  variable  emerged  with  a  corre- 
lation that  was  significant  enough  to  explain  the  change 
order  rate.  The  measure  of  the  proportion  of  total  varia- 
tion in  a  dependent  variable  that  is  explained  by  a  regres- 
sion line  is  the  coefficient  of  determination,  or 
"r-squared"  value. i®  lach  of  the  independent  variables  alone 
failed  to  yield  a  coefficient   above  6.0  percent.    The  best 


1  ■'Based  on  a  95  percent  confidence  level. 

isThe  coefficient  cf  determination  or  "r-sguared"  value 
can  range  from  zero,  which  denotes  no  correlation,  tc  unity, 
which  represents  perfect  correlation. 
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fit  found  was  a  multiple  regression  of  the  bid-t o-Government 
estimate  ratio  and  the  number  of  change  orders  against  the 
actual  change  order  rate.  Only  an  8.2  percent  coefficient 
existed  here  with  "t"  ratios^^  for  the  bid-t o-Government 
estimate  and  number  of  change  orders  equal  to  -4.64  and  2.87 
respectively.  Since   the      values      of      the   coefficients      of 

deter ninaticn  are  so  close  to  zero,  the  change  order  rate 
explained   by  the   independent   variables    is    insignificant. 

SubpopulatioDS      of         geographical      areas,  funding 

sources  and  time  frames  failed  to  isolate  any  further  data 
that      could   provide      useful    regressions.  Plots    of      change 

order  rates  against  each  of  the  independent  variables  indi- 
cated that  little  resemblance  of  a  linear  relationship 
existed  in  any  case.  Figure  3.3,  the  plot  of  actual  change 
order  rate  versus  bid-to-Go vernment  estimate  ratio,  detcn- 
strates    this  point. 

5 .      Findings   of    Varianc e   Analysis 

In  all  analyses  of  variance,  95  percent  confidence 
intervals  for  level  means  were  assumed  in  hypothesis 
testing.  One-way  analyses  of  variance  were  performed  for 
each  of  the  two  independent  variables  (actual  and  "equiva- 
lent"  change  order    rates). 

a.      Award   Date   Periods 

Two  analyses  of  variance  were  performed:  (1)  by 
fiscal  year  and  (2)  by  fiscal  year  quarter.  If  improvements 
have  resulted  in  controlling  change  order  rates  due  to 
KESTCIV  efforts,  then  significant  differences  in  change 
order  rates  should  lie  among  the  the  five  fiscal  years.  At 
least   a    significant    difference   between       1978    and    1982    should 


19^  "t"  ratio  should  be  at  least  plus  or  minus  2  to  be 
considered  significant  enough  for  an  independent  variable  to 
used    in    a   regression    equation. 
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Figure  3.3    Plot  of  Change  Order  Rate  vs.  Bid/Govt  Est. 

exist.  The  hypothesis  is  that  there  has  been  significant 
improvement  in  reducing  change  order  rates,  and  that  it  will 
he  demonstrated  by  a  change  order  rate  confidence  interval 
for  1982  that  is  below  the  lower  limit  of  the  confidence 
interval  for  1978. 

There  is  a  common  perception  that  contracts 
awarded  in  the  fourth  quarter  tend  to  be  "rushed"  in  the 
attempt  to  award  before  the  end  of  the  fiscal  year  and  that 
the  quality  of  specifications  and  drawings  is  therefore 
sacrificed.  If  this  true,  then  a  significantly  higher 
change  order  rate  should  be  seen  for  awards  made  during  the 
fourth  quarter   in  contrast   to  the   other  quarters.     This 
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hypothesis  will  be  affirmed  if  the  lower  limit  of  the  fourth 
quarter  chanje  order  rate  confidence  interval  is  greater 
than  the  upper  confidence  interval  limits  of  the  ether 
quarters. 

Analysis  of  variance  for  both  cases  reveals  that 
no  significant  differences  in  change  order  rates  can  be 
found  between  any  of  the  fiscal  years  or  fiscal  year  quar- 
ters. Iherefore,  no  improvement  in  reducing  the  WESTDIV 
change  order  rate  ever  the  five  years  was  observed. 
Although  there  was  no  statistical  difference  in  the  change 
order  rates  among  the  four  quarters,  it  was  interesting  to 
note  that  the  mean  change  order  rate  (both  actual  and 
"equivalent")  for  contracts  awarded  during  the  fourth 
quarter  was  the  lowest. 

b.  Other   Findings 

Analyses  of  variance  for  amounts  of  award, 
funding  sources,  number  of  bids,  winning  bid-to-mean  bid 
ratios.  Category  Codes,  and  unemployment  levels  revealed  no 
significant  differences  in  change  order  rates  among  the 
various   cells- 

c.  Geographical   Areas 

Among  the  eight  described  geographical  areas 
there  were  no  significant  differences  in  change  order  rates 
between  any  two  areas.  An  analysis  of  variance  clearly 
shows  that  there  is  a  significant  difference  in  the  change 
order  rate  between  construction  contracts  performed  in 
"rural"  areas  and  these  performed  in  the  "metropolitan"  or 
high  density  areas.  Rural  areas  incur  lower  change  order 
rates  than  do  metropclitan  areas.  Figure  3.4  shows  the  95 
percent  confidence  intervals  for  each  of  these  twc  cells. 
The  upper  limit  of  7.1  percent   for  actual  change  order  rate 
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(based  on  a  pooled  standard  deviation)  for  rural  areas  is 
exceeded  by  the  metropolitan  areas'  lower  limit  of  7,3 
percent. 


(Based  on  Pooled  Standard  Deviation) 

Metropolitan  1*******1******* j 

Rural  **********!************! 

2.0      3.5      5.0     6.5      8.0      9.5     11.0 
Actual  Change  Order  Rate 


(Based  on  Pooled  Standard  Deviation) 

Metropolitan  j*********j ******* 

Rural  *************!**************! 

2.5      4.0      5.5       7.0       8.5      10.0 

Equivalent  Change  Order  Rate 

Based  on  214  "Metro"  and  86  "Rural"  Contracts 


1 

I 

-J 


Figure  3-4    Variance  Analysis  for  Geographical  Areas, 


d.   Winning  Bid  to  Government  Estimate  Ratio 

The  most  significant  findings  in  the  difference 
among  change  order  rates  are  found  in  the  varying  ranges  of 
this  ratio.  Generally,  it  is  found  that  change  order  rates 
tend  to  be  high  when  the  winning  bid  is  proportionately 
lower  than  the  Government  estimate.  Conversely,  change 
crdk^r  rates  are  significantly  lower  where  the  winning  bid  is 
much  greater  than  or  very  close  to  the  Government  estimate. 
Figure  3.5  shows  the  95  percent  confidence  intervals  for 
change  order  rates  among   the  cell  classifications  described 
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Figure   3.5        Variance   Analysis   for    Bid/Govt   Estimate. 

in  Section  C.2.  of  this  chapter.  There  is  a  significant 
difference  in  change  order  rates  for  both  the  actual  and 
"equivalent"  change  order  rate  between  the  ratio  extremes. 
The  difference  is  significant  between  contracts  where  the 
ratio  is  84  percent  and  lower;  and  where  the  ratio  is  either 
119  percent  and  higher  or  between  97  and  103  percent.  Tvnere 
the  ratio  is  roughly  between  3  and  16  percent  on  either  side 
of  the  Government  estimate,  no  significant  difference  (at  a 
95  percent  confidence  level)  in  change  prder  rates  can  be 
detected.        One    reason   explaining    why    change    order    rates    are 
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significantly  low  where  the  winning  bid  is  within  three 
percent  of  the  Government  estimate  could  he  that  these  are 
considered  "clean,"  risk-free  jobs,  and  the  work  and  costs 
involved  are  clearly  discernatle  by  both  the  Government  and 
the    contractor    estimators. 

This  ratic  may  be  of  some  use  to  the  Contracting 
Officer  in  assessing  the  level  of  competition  for  a 
contract.  If  a  contractor's  bid  is  significantly  lower  than 
the  Government  estimate  (approximately  15  percent),  the 
likelihood    cf   high    change   order    rates    can    be    anticipated. 

D.       SUMMARY   OF    ANALYSIS 

A  database  with  recent  construction  contract  information 
was  developed  so  that  the  principles  introduced  in  Chapter 
II  could  be  challenged  for  validity.  It  was  necessary  to 
make  a  number  of  refinements  to  the  data  so  that  various 
external  influences  such  as  nonserious  bids,  peculiar 
geographical  characteristics,  and  terminated  contracts  t nat 
distort  any  general  trends  in  change  order  rates  could  be 
eliminated. 

A  general  statistical  program,  Minitab,  was  used  to 
calculate  a  number  of  analytical  determinations.  Chapter  II 
introduced  the  notion  of  competition  intensity  as  a  variable 
that  affects  the  profit  margin  that  contractors  apply  to 
bids.  It  is  a  general  hypothesis  of  this  thesis  that  as 
competition  intensity  increases,  winning  bidders  tend  to  be 
contractors  who  are  willing  to  assume  greater  risks  than 
their  rivals.  They  apply  lean  profit  margins  to  their  bids 
and  expect  change  orders  to  ultimately  improve  their  finan- 
cial positions.  The  measures  of  competition  intensity 
introduced  in  Chapter. II,  in  addition  to  two  measures  intro- 
duced by  the  author,  are  applied  in  the  database  analysis  to 
determine      what    conclusions      can    be      drawn.         Finally,         the 
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incidence  of  change  ciders  among  varying  classifications  of 
geografhical  areas,  time  periods,  price  ranges,  and  unem- 
ployment  rates    was    examined. 
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IV.     SQMMMX    ME    CONCLgSIONS 

A.        SOflMAEY 

The  excessive  use  of  change  orders  in  GoverniDent 
contracting  has  been  alleged  to  he  the  result  of  impro^ier 
diligence  and  care  by  management.  The  cnange  order,  in  its 
original  conception,  was  intended  to  be  a  remedy  for  the 
imperfections  of  contract  language  and  depictions  so  that 
Government  and  contractor  parties  could  proceed  in  executing 
the  contract  to  a  smooth  end.  Although  change  orders  are 
intended  primarily  as  a  convenience  for  the  Government  so 
that  "in-sccpe"  modifications  can  be  made  to  contract  draw- 
ings and  specifications,  there  is  some  evidence  that  the 
contractor  has  used  change  orders  to  his  advantage.  Ihe 
intensity  under  which  construction  contracts  are  bid  creates 
a  highly  ccmpetitive  environment  that  demands  a  careful 
trade-off  between  a  rational  profit  margin  and  a  competitive 
price    in   order    to   win   and  stay    in    business. 

It        has        been         suggested  that        the        winners        of 

competitively-bid  contracts  are  frequently  contractors  who 
fall    into   several   categories:  (1)     they   enjoy  the   advantage 

of  economies  of  scale  over  their  rivals,  (2)  they  are  mere 
willing  to  assume  certain  risks,  and  (3)  they  see  the  oppor- 
tunity to  improve  their  financial  positions,  once  the  objec- 
tive of  winning  the  bid  has  been  attained,  by  recouping 
losses  through  change  orders.  The  limits  that  govern  the 
extent  to  which  contractors  and  contracting  officers  can  use 
contract  language  to  resolve  issues  of  contract  ambiguities 
in    their   favor    have    been   defined   through   legal  precedent. 
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Seme  of  the  theories  and  concepts  of  bidding  strategy 
were  applied  to  a  model  of  representative  construction 
contract  data  to  test  for  their  validities.  Chapter  II 
introduced  three  conventional  measures  for  intensity  of 
competition  that  were  applied  in  the  analyses.  Bisk-takers 
and  "tuy-in"  bidders  presumably  emerge  as  victors  in  the 
bidding  game  under  conditions  of  intense  competition.  For 
this  reason/  the  number  of  bidders  on  a  contract,  the  spread 
between  low  bidder  and  next  lowest  bidder,  and  the 
bid-to-Gcvernmen t  estimate  ratio  were  used  in  regression  and 
variance  analyses  to  determine  the  validity  of  this  state- 
ment. Two  other  measures  were  introduced  by  the  author  for 
use  in  analysis:  tie  bid-to-mean  bid  ratio  and  the  number 
of  standard  deviations  of  the  low  bidder  from  the  mean  bid. 
Chapter  III  considered  a  nunber  of  predictive  variables  that 
might  help  to  explain  the  conditions  that  affect  change 
order   rates. 

It  was  necessary  in  the  analysis  to  make  several  assump- 
tions and  refinements  to  the  data.  This  was  done  so  that 
the  data  could  be  analyzed  without  the  influence  of  outliers 
to    distort    any    general    trends, 

B.       CCNCIOSIONS 

Change  orders  do  net  appear  to  be  influenced  by  any 
dominant    variable      or  combination    of    variables.  There    are 

many  miscellaneous  factors,  apparently  randomly  distributed 
throughout  the  contract  administration  process,  that 
contribute  to  contract  price  growth.  These  factors  include, 
but   are   not   limited    to: 

•  Contracting    officer   and    contractor      expertise    and   compe- 
tence. 

•  Availability   of    cccstruction    materials    and  labor. 

•  Architect-engineer   competency. 
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•  Ccntiactor      business      windfalls      or      failures      en      ether 
concurrent    jobs. 

•  Backlog    of    contracting    officer   paperwork. 

The  results  of  analysis  were  conclusive.  No  direct 
relationship  exists  between  the  change  order  rate  and  any 
simple  ccinbinati  on  of  variables.  The  most  significant  find- 
ings for  the  variables  that  were  considered  lie  ir  the 
change  order  rates  among  varying  bid-to-Government  estimate 
ratios      and    geographical      locations.  Change   order      rates 

appear  to  be  higher  when  the  contractor  bid  is  at  least  15 
percent  below  the  Government  estimate.  When  the  contractor 
bid  is  very  close  (within  three  percent)  to  the  Government 
estimate,  or  when  his  bid  is  approximately  twenty  percent 
above  the  Government  estimate,  change  order  rates  are 
significantly  lower.  This  information  may  be  useful  to  the 
contracting  officer  in  anticipating  the  magnitude  of  change 
orders  for  a  contract,  since  it  is  information  readily 
available   at  bid  opecing. 

There  is  a  significantly  lower  change  order  rate  for 
construction  contracts  awarded  for  "rural"  Naval  activities 
than  there  is  for  contracts  awarded  in  metropolitan  areas, 
such  as  San  Diego,  Los  Angeles,  San  Francisco,  and 
Seattle/Bremerton.  The  explanation  for  this  is  speculative, 
but  one  may  infer  that  "rural"  contracts  are  "cleaner"  or 
that  the  intense  bidding  competition  in  the  metropolitan 
areas    contributes   to    higher    change   order   rates. 

A  discovery  incident  to  the  aim  of  this  thesis  was  that 
the  change  crder  rate  was  remarkably  similiar  to  the  spread. 
Cx  the  169  contracts  with  U  or  more  bidders,  the  actual 
change  order  rate  mean  was  7,91  percent  with  a  standard 
deviation  of  12.10.  The  mean  spread  was  9.36  percent  with  a 
standard      deviation    of      13.06.  These      figures    imply      that 
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statistically,       for    a   95   percent    confidence    level,       there   is 
no   significant    difference   between    the    two. 

C.       FOIOEE    EESEARCH 

The  intent  of  this  thesis  was  to  identify  variables  that 
significantly  influence  change  order  rates.  Data  was  there- 
fore refined  so  that  general  trends  could  be  examined.  One 
obvious  shortcoming  in  the  analyses  was  in  the  consideration 
given  for  the  type  (structural,  electrical,  mechanical, 
earthwork,  etc.)  of  construction  and  the  effect  it  has  on 
the  change  order  rate.  Future  research  could  explore  this 
variable  for  significant  relationships  in  change  order 
occurrences. 

There  is  coom  for  more  study  on  the  performance  of  goal 
standards  established  in  the  NAVFAC  Command  Ilanagement  Plan 
for  controlling  change  orders.  Research  could  net  only 
determine  how  well  the  Engineering  Field  Divisions  are 
performing  under  these  standards,  but  it  could  identify 
where  weaknesses  exist.  Such  factors  as  geographical  loca- 
tion, construction  type,  or  type  of  facility  may  be  selec- 
tively   examined. 

The  analysis  of  bid  spreads  could  determine  when  a 
justifiable  move  should  be  taken  to  cancel  and  rebid  for 
contracts  or  when  it  is  feasible  to  remain  with  a  lew  bidder 
even  if  ether  forms  of  contracting  (for  example,  negotiated 
fixed-price)    seem   desirable. 
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APPENDIX  A 
DESCRIPIION  OF  DATABASE  VARIABLES 

DATA  GROUP  1 


ColumE  1 

CONTRACT  NUMBER 


The  number   assi'jned   by  WESIDIV 
prior  to  the  Invitation  forEids 
\    6-digit  number  ),   identifying 
the  contract. 


Column  2 
AWARE  EATE 


The  date  the  contract  was  award- 
ed by  WESTDIV  to  the  contractor. 
(Year-Month-Day) 


Column  3 
AWARE  AHCDNT 


The  amount 
awarded  for 
of  work  identi 
in  the  CMS. 


of  money   originally 
a  particular  portion 
:ied   by  '  ' 


line  item 


Column  4 
GEOGRAPHY  CODE 


The  location  of  construction, 
derived  from  the  Unit  Identifi- 
cation Codes  listed  for  each 
contract  in  the  CIS: 

10  Metropolitan  San  Francisco 
area. 

11  Northern  California/Nevada 
area,  excl.  San  Francisco 
metropolitan  area, 

20  Metropolitan  Seattle/Er em- 
erton  area. 

21  Washington/Oregon  area  ex- 
cluding Seattle/Bremerton. 

30  Metropolitan  Los  Angeles 
area  . 

31  Rural  Los  Angeles  area, 
incl.   Ventura  County. 

40  Metropolitan  San  Diego 
area. 

41  Rural  San  Diego  area,  in- 
cluding Arizona. 


Column  5 

NUMBEE  OF  BIDS 


The  number  of  responsive  and 
serious  bids  submitted  by  con- 
tractors in  response  to  the  In- 
vitation for  Bias. 
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Column  6 

MEAN  BID 


The  average  amount  bid   for  each 
contract,  egual  to: 

Sum  ox  bid  amounts  per  contract 

■'1  ■  ■  ■ 

Number   of    bids    per    contract 


Column    7 

NUM3EE    OF    CHANGE    OREEBS 


The      jQumber      of  dollar-valued 

change    orders    to   a   contract. 
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DATA  GROUP  2 


Column  1 

GOVEENMENI 


ESTIMATE 


The 


independent  estimate  of  con- 
struction made  by  the  Government 
for  work  corresponding  to  the 
ha.se  bid  and  bid  additives  act- 
ually awarded. 


Column  2 
WINNING  EID 


The  winning  bid  for 
by  the  contractor, 
all   work   segments 
sources . 


the  contract 

inclusive  of 

and  funding 


Column  3 

WINNING  EID  TD 
MEAN  BID  RATIO 


The  ratio  of  the  winning  bid  to 
the  mean  of  bids  for  a  contract. 
Values  close  to  unity  indicate 
relative  closeness  of  the  win- 
ning bid  to  the  competition 
average. 


Column    4 

WINNING    EID    TO    GOVERN- 
MENT   ESTIMATE    RATIO 


The  ratio  of  the  winning  bid  to 
the  Government  Estimate.  Values 
above  unity  indicate  a  winninq 
bid  that  exceeds  the  Government 
Estimate. 


Column  5 

ACTUAI  CHANGE 
ORDER  RATE 


The  actual  change  order  rate  ac- 
counting for  both  additive  and 
deductive  change  orders,  ex- 
pressed as  a  percentage: 


Final  contract  price 
Original  award  amount 


-  1  X  100 


Column  6 

"EQUIVALENT"  CHANGS 
ORDER  RATE 


The  change  order  rate  adjusted 
to  dilute  the  effect  of  deduct- 
ive change  orders,  and  to  ac- 
count for  the  difference  in  the 
final  product  from  the  original. 


egual   to: 

(FCP    -    DCO's    +    VECO's) 

(Original    award   amount) 


-    IX    100 


FCP 

DCO's 

VECO's 


=   Finaj.   contract   price 
=    Deductive  change    orders 
=    Value    Engineering 
change   orders 
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DATA    GROUP    3 


Columii    1 

CONIBACT    NUMBER 


The  number  assigLed  by  WESIDIV. 
(This  number  can  be  used  as  a 
cross-reference  for  data  in  the 
first    two   Data    Groups.) 


Column  2 

SECOND  LOWEST  BID 


The  amount  submitted  by  the  sec- 
ond lowest  bidder  for  the  con- 
tract. 


Column  3 

NUilBZR  or  STANDARD 
DEVIAIICNS  CF  LOW 
BID  PEOM  THE  MEAN 


The  number  of  standard  devia- 
tions that  the  low  bid  for  a 
contract  lies  from  the  mean  of 
bids  for  that  contract,  ex- 
pressed as: 

(Mean  bid  -  winning  bid) 

Standard  deviation  of  bids 


Column  4 
BID  SIRIAD 


The  percentage  of  spread  between 
the  winning  bid  and  the  second 
lowest  bidder,  expressed  as: 


^Second  lowest  bid 
Winning  bid 


1 


100 


Columns    5   and   6 
ACTUAL    CHANGE    ORDER 
"EQUIVALENT"   CHANGE 


RATE  and 
ORDER    RATE 


(As    described 
GROUP     1) 


in    DATA 


67 


cqi 

X\ 
HI 

oi 

S5| 
W| 

(^\ 

04l 


•a! 

EH 

<< 
Q 

CO 
H 
CJ 

<i 
« 

O 
U 

z 
o 

H 
H 
U 

a 


to 
u 


to 


I  Q)  (ts  a  o  *  t  q; 

aw       (T3  3:  C/3  to  M 

■HO       U+J-M-P  03 

-C  W  U  U 

On  CU  t/)  M  I-IO 

ri  >fTz)  Q  m-p+Jt- 
O-H  q;  a-H  G  «»- 

l-j  C  (/}  314-1  o  o 
CnO  32:       U  0-C5 

O  (/}     +J  a)Z2  3 

3e  OJ  QJ  U^OS  O 

+Jn3-Q  (T3-MUO  (-1 

3       M      S      J3 

u)  u  td  G  G  q;  M 

•H-H      U       n3      cri4J 
m       M       en    O       O 


o 

z 


c 

03 


o 


13 
•H 


<u  0)  3mo  »rd 

»} 

0  OtC)^  or^rn  w  1-1 

t 

'd 

J33a-PM»-       4J-M 

0 

•H 

H  0  3      en    -G  U  d 

Z 

CQ 

U  Gt^      j:J  CrxtJ  O 

Cn     GTS  Cn3  t-i  U 

t           (t3  t-l  3  O-M 

t 

co^a  3     -H  0  (-1  G2: 

^ 

cn 

a) 

CLiM  0  wG  (-i-G  os: 

0 

na 

3-H  (-^  W4J-G-M  UO 

Oi 

a; 

0 

0-^       O,     -M 

a 

0 

u 

M+J  0)  3  0)      CNZ  0) 

0 

Cr>     x:  O-ciT-cTiO  !-l 

cc 

QJHM+J     T-cjn3 

CD 

(U-G      ty\     m      rr: 

(D-P           G  a":3      Ch 

«3 

4J 

U         •  0  CU  0  G  0)^0 

H 

T^ 

G 

J=:       Ui  3  (UM  03  M«- 

-< 

M 

3 

-P.»U-t-»S               (TJ 

Q 

03 

0 

(0  0)     +j  %  *    x: 

3 

a 

G+Jt:3  4J  a;  W  (/)      Cr> 

< 

«: 

•H  UtJ  UJJ3  a»*JOO  3 

(T3-H  M       3  UCT)  0 

Q)  NXI-H  0)  0  03       1-1 

M4J      M-iUMM-G-G 

03  G  a>       G  DHJ  Cru-J 

0  M  (U  <U       G  3 

03  U  O-^  1-1  0  0  0^ 

4J     a-M  o;  :s  u-cj'- 

(130            M-(+J       V*- 

^O 

Q) 

^30  M  G  a;    fi^ 

M 

-M 

<^)  U  01  W4-"a:'-  Ui 

03 

03 

u>  1  yiz     3 

? 

« 

0>           3  WM         %0 

<«; 

GH  M+J  CO'H  0^  CUM 

;-^r-i  3  <D  OH-l  M  3 

»  03  O-U  M       03  0-73 

0      M-i       0  (U       M  G 

f-H           CU      j:5»-  Cno3 

4J 

iH  M-C  U  Q)4JCr. 

u 

M 

0  O+J  GJi      '-'«  C/3 

03 

OJ 

m>4^.H  cy+J  M     m-m 

M 

,« 

3M       O^-HU 

+J 

a 

a>  03     q;  wpm  f^vG  03 

G 

3 

J5-MUiM-lo3       a+JM 

0 

s 

H  03-M  Q)            0       -P 

U 

fo  u  mt3  .  m  a>  g 

03  1    u;U3-G^  0 

•  •0^  M  03  W  UtfJ4J  0 

CPna+J  CO  3  3 

-P  3  G  0       0=r  MlJ-i 

DB 

OH  0  M  CU  Mr-  o-o: 

0 

3  U  u  ux)OT-u-.a 

W 

^  (N  f^  ^  fN  r~« »- 00  ^- r^  rM  T— r^  o>  m  CM  r^  T— no 
^  r-»-  «—     rorsj         CM     rs| 


rsj:^LnGOrsioof^mcoLnron(NLn^^rovo 
^  m  <Ti  ^  rn  m  o  LO  f^  00  3- ^o  no  uD  CO »— r~- cTn— 

o  <ri  CO  ^  o  o^ '- =r  r~»  ld  »— "X)  CO  c7\  T- ro  en  r*  r^ 
coif  )r»  vo  \£>  cTi  r*»  LD  cri «- o  CN  ui  ^  un  CO  p*  rt  r» 

r»CN^<S^:3Ts|rO(N^oroa>^POro»-roPO 

rocj- 


sO 


in 


in  ro  no  ID  v^  (N  fN  ro  ro  cr>  00  CN  00  vo  «N  ^  vo  •=»' vn 


•— OOO'-'— 000^- r- 0000  r- 000 
CN  CN  (N -a- rn  <^  CN  r- :3- cr  00  ^  ▼- »— T- r- ^  Oj  r- 


r*cr>irKNOOOooooi-ncox)Ocoo'-r^ 
<T\cor\i^ooooooo(NvDr^ror»or*-^o 
rsj  M3  (N  en  o  00  o  CO  o  o  o  r~>  CO  (N  ^  rs)  CO  vO  CTi 

CO  vo  en  ^  r^  cr>  CTi  uo  CT> «— U-)  =t «— ^  un  lo  cs)  r^  T- 
o  r- 00  CN)  vX)  ^  r^  <N  ^  ^  in '- T- »- ^  00  00  cTi  00 
r*CNro(Nro^rorofNcnnror-«^oorocr\(NO 

rooo  Ko     :3-ro         in     =t 


oOT-roo'~^"^^cnoooocr»Ln^rMcocoin 
CNjrooroo  oooorom  T— <r-(Mo(N  CMO'— 

I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I 
O  O »— »- <N  CN  CN  (N  CN  fN  fN  r- T- T- CN  cs|  CN)  ro  m 
»—T-r-T-r-r-T-T-T-r-r- 00000000 

I     I     I     I     I     I     I     I     I     I     I     I     I     I     I     I     I     I     I 

r*"  r»  r- r^  r~- r-<  (^  r- r^  r^  r^  00  00  CO  CO  CO  00  CO  CO 
r*  r- r»  r^  r**  r^  r^  r-^  r- r- r^  p^  r*  r~- r*  r- r~  r-~  r^ 


:3' or*  O  <X»  CTi  O  en  ^  CO  in  P-- ^  (N  r*  fN  O  r- CO 

^3-uDcor>or-vou~)t^OT-rovo<N(siinr^>X) 

r*-r-(Nr>cNr^in(NfNr~vofNr~i^ocNr-rsM3 

I   I   t   I    I    I    I    I    I   I    I    I    I   I    I    I    I   I    I 

vt>  i^o  r*  >>o  (^  uj  00  p*  r~  u3  in  r~- vo  VX3  CO  r-- vo  r*  u ) 

p*  r»  r>  r^  r^  r- r»  r»  r^  r~  r^  r- r^  r^  r-~  r*  r*  r- r^ 


r- (Nco  =*  m  u3  r^  00  en  o  ♦- cN  m  =*  in  ^  r^  00  en 


68 


CO  rn  no  ro  r^  u^  r-*  oD  ^£)  p>H  in  r- LO  o>  IT)  LO  tn  o  =t  cTi  cTi  ro  o  ^^  o  o~i  :3- u^  r^  no »— r^  ^  OD  ^.D  o  t^  (N  o^^ 
CO  ro  [~.  ro  o  o  u^  ^13  o^  :s- :3- o^  c7>  CN  CT>  ct  ^x)  w  r^  r^  u^  cTi  vi5  r~>  r*  r^  cj  a^  r^  T- vi3  CN  ^  r- r>- <— r^  (N  r*« 

t^  00  o  r~  (^  T- o  (N  >>o  po  cr  o^  LO  r*  o  ^  r^  csi  r^4  oD  cTv  r^  00  cr  \£)  r- CO  rn  en  "^  CN  ^  cx)  00  cr  :d- rn  r  J  ro  cr^  =r  03  r\)  ^  o  ro 
CN  ^  cr»  CN  T- T- in  cTi  o  =r  en  iT)  =t  iT)  CN  r- o>  oD  CT^  o  o  T- crv  CO  T- cTi  Ln  ^  r^  u^  u^  00  r^  00  :*  T- o  ^£) '^  :*  rs)  r- a>  r- r>- u^ 
L()r»^<^)<o^^o^n^ooc^;ro^o^(^^^^OCN>^OCI^o^•)'sU^ocNa^PO^^CN^^*co=3'0^lO^^^^^^^*•^n^ou^^cor^u^co 

r-  cr       CN       ^  r- r-CNLDT-  sT       <— vXJCnC)  t—  CO 


r^^inP*-CNv^0^P^U^c»00U^in^U^niCNr*-00(N^O00vD;t^^CN000000r»»00CNCNr-u^^U000L0CN=f^Cr.00r»00 


OOO'-OOO'— 0  00O0OO0^-OO0r-»-OOt— t-OOOt— «— 0  000»-000r-000^— Or-OO 
^::ITOrnor):3-^f^'i-^OO^T-crT-:;J-^»-^cJ-:3-POCN^rOOO^OOOO::r<N^^cr^or);:3-CN'-on'^^moor-oo^T- 


:*cooaoo^:3-o>^ooo^^r^cri^ooo»-r^oocTioco=f  OLnoT-cNorsjoooocNooooooo^Ti 

=tCTiOU3in:::rCNOOOOCTiOO>X)CnoOOCriT-OOCr>r-T-cOO'— Or^'-OOvOCNOOOCNOCNOOOOOm  Tj-T- 

ctcno'— rvir~'OOo»— r^r^^^^c^o(Tl(T^o^^ovOLna^tr)OcTlcr^sJl^loao^^ooovOvO'— oocNO'—i-nooooocj-MO 

CO  en  IT)  CTi  ^  :*  en  oo  OD  CN  ^O  lO  *- =t  r^  O^  »— T- CT^  ^  0^  vO  O  LO  U^  00  UO  CO  00  00 '^  CO  O  (Ti «— -^t  00  ^  U^  oo  P^  rv)  P^  v^ 

<o  en  o  cr  00  en  "^  00  (N  CO 'X»  o  00  (^  00  uo  (^1 T- r^  oD  CO  o^  T- u^  o  LO  ovj  u^  sO  u^  vo  CN  uo  r^  rt «— CO  ^D  (N  00  uo  o^  lo  cr>  u^ 

•i^  (T)  ^O  (N  in  CN  00  f^  CN  CN  r»  en  ^  ro  00  C^  r^l  ^  O  <o  OO  o  00  ro  CN  r^  00  00  (N  CN  M3  f^  CN  T— O  rsj  ON  \^  r^  00  CN -ir  :3- MD  M3  :3- cr  LT) 
t—  ro     CN     ^-         *— '-•CNi3'»~  ^     r-vornoo  T~         r~ 


r*~  T— T- T— CO «— on  v^  CN  LO  00  CO  o  c^  =t  ^  ^- lo  <N  ^o  CT>  C7>  cr.  o>  c>o  ::}•  ^  en  cTi  o  o  ui  uT  u^  »■■  CN  en  en  en  00  LT)  CO  en  ^  r- r-.  00  in 

»— OOOOCNCNoOCNOt-CNCNOOoOt-'— T-CNCNCNJCNCNCNCN'-rNirslCNOOOOOO'-CNCNrNrsirMO'-'-'-CNOOOO^ 

I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  )  t  I  I  I  I  I  I   I  I  I 

ro  00  00  •:3- ^  U^  UO  in  VO  vO  v£)  vJD  VO  00  CO  CO  en  C7^  en  en  en  (Ti  en  en  O  r- r- r- ^  »— T- CN  CN  rN  fN  CN  CN  CN  CN  «"  »"  <— »" '"  »— (N  CN  eN 
0OO0C3OO0OOOC3OOO0C3OO00  0C3O'-'— ^-'-'— '—'-'— T-*-r-T-T-r-r-O0O0O0C3O0 

I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 

CO  CO  00  CO  CO  CO  00  CO  CO  CO  CO  00  00  00  00  CO  00  00  00  00  CO  00  00  00  00  00  CO  CO  CO  00  00  00  00  00  00  CO  00  CO  CO  C7>  cTi  en  en  en  cTi  en  en  en 

r*«  r~~  r^  r^  r^  r~- r^  r~  r^  r^  r^  r^  r»  p^  r^  r^  r^  r>  (^  r^  r^  (^  r^  r^  r**  r^  r^  r**  p*  r»  r^  r~- r«»  r*- r^  t^  r*  r^  t^  r^  r^  t~*  r^ 


^  vo  CO  ^  ro  r^  03  in  CO  o  1^  ro  p^  C7^ »— r— rn  ro  oo  f^  en  p~- o  00  ^  ro  o  c*  00  r^i «— en  vo  fo  ^  en  ro  CN  in  o  ro  en  cj- (N  CN  CN  LO -ij- 
^  c>o  cN  P^  ▼— in  f^  lo  o^  r~» '~  ::r -a- c^  00  o  t^  p^  ^  r^  en  uo  ■:3- 00  00  00 1^  LO  00  00  00  *x>  ro  u^  vij  CO  en  o  r*- r^  CN  ^~  o  cr  uo  CN  r- ^ 
oocNf^^iJor)>j3\£i^f^un(-sjP^u)Ln.=r>x>r-ooourMor^^oe\)ir)r--uKN»— ocnt— o^— ooou  )^aj:3-a;ojT-cnooo'— 

■^r^r^CNfNcNCNOCN  CNesJO^OOrsJOO  eNCNCNf*- CN<NOOCNCNCNCNCNOCNCNeNCNOOO^OOCNr»r^00  r^  ^r^ 

t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  t  I  I  I  I  I  I  t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 

f— \X)  vi)  p^  r*"  p^  p*  00  r^  r~»  c^  CO  a  ">  CO  r~  CO  03  r*>  p^  p*  vo  r^  r^  eo  ou  r^  i^  r^  r^  r^  CO  r^  r^  r^  r»- ou  cjj  oj  in  CO  CO  r^  ^  vo  :3- \o  lo 
p*  P-- p~  p^  r^  p-«  1^  p-- [^  p^  (^  p- r^  p^  r^  pv  t^  p«- r~- r>»  r^  p~  p*  r^  r^  r~  p^  p^  r^  p~  p~  r^  p~  r~  p~  r~  p~  r^  r^  (^  r~  r- r~  p^  r»  r^  p~  r^ 


o^-cNrocrLOvor^'GOCTior-cNro^inMDr^eoo^O'— cNro^in>X)p~cocno'— cNf^=*Ln>j3P~cocno»-cNoo^invDr^ 
c^JfNCN^^JCNcNCNCNfN(Noooo^of^oo^ooooooooo■=rct^::3•^:3•^--^cr^lr)uoLnLnlnu^LOu^u^Lnvo^^^^ovo\^ 


69 


unpo=tu^<^zr«-rn=rrN4a><Nor^^r^=t(NOvo^-^r*«aDocNo^:r<Ti:rOfvio^-r\ir-Ln>x>o~i(N>oou^POj:jc^ 


r-fv^cocrrnrn'— r^^r>^a^ao^o^c^ooooLnc^JO^f^oo▼-'X)rn^o^^|LnLno^ooo<T>a^^aor»LnLO^Loro 
orovO'— ir)u^co^Lnr-^a3u^^ox)ornrsiM3T-ot~*o^^coa3sDv'NO>cNcnor^T-cNr>'r^r-r*r^p^r^sOOT 

r^j  r^  Ln  cnj  cc  OD  00  u^  ^  r- 03  r~  r^  u^  on  r~  oD  cTi  (N  ^ -■3"  CO  r- 03  o  o  u^  un  ^x)  *x)  cc  CO  (n  a^  T— C7^ »— ro  v^ 

>^o  rvj  CO  CO  r^.  ro  <N  r^  r^i  T- a^  CO  cf  f^  r- 00  r^  OD  r~- en  CO  o^  r~»  in  r»  n^  o  CN  o  rvj  r- u^  rn  rn  cN  ^  03  in  ^  on  CT^  3- 

^oinajcNcn^a-cu^Ln^-cnror^crioo^fNra-ooor^tNCNf^onao^ro^rNrsjrn  -5'CocovjM'*ij^o-0:3-inrN3T*»c)ro 


invorv4=rp^vX)(^oooo5rooo\o^T-ocr^rsicNniminvo»-<Nr^o<^rncNoio>jr-T-f^sf  o^M^^::Jo^^or~^^m<^ 


OO^OOOO*— O*— ^00  00  00000  0r-0«— OT-OOOr-OO'— *— Or-T-r-T-O'— '— '"OOOOO 


OOCriOOCr»:3-0 in LOOfNOTiO>£>OOcrnoinOOO^^Cr>OOOOCOOOCT>00  3- ^T-O^ 00003^0 OCNr- 

ooLnooLn>v00cooor^o^oocNo=ro^rnT-oo'Xioooooooi-ooorsjooo3r-r-.ooo(NLnor^r* 
ooco(J^oocJ•ooc^omoo^O(TlOco^^>^u-)oocoo^(NOorNmo^sIcno^^oo^— ,0'-LOc3-0'--:5-OsDcr> 

CO  o  rr  o^  r^  ^  lo  1^  03  CN  ^  en  CO  rs)  ro  cTi  m  :rt  r- en  rn  o^  CO  rsi  o  »- '>o  r^  r~»  cTt '  o  CO  f^  en  t— rn  =3- -O  CN  03  cTi  o  i^ 

CN  a^  ^3- m  cj^  m  r^  ro  o  m »— 03  m  r^  r- 1^  CO  r^  r^  CO  in  vo  CO  CO  r- v^  :d- \X)  ^  CN  rsi  rn  CN  (^  (N  rsi  ^  o  ro  00  m  1^  (N  ("nj  cTi  o  o  r^ 

en  ^£»  m  CO  (^  ::t  ^^  CO  ^  ^  cN  cf  r- o  en  o^  r»  (N  C3- o^  (^  vi3  r^  00  o^  rsl  t^  m  cN  <N  >o  rsl  CN  :3- CO  ^  r^  r~- vx3  03  m  it  in  (^ 

<vor»'-     ^m    CO        (NCNin  ^  fNo>^  en  m'-'~     '—  cncnt- 


(Nrnrna3cocoencr^^orsicoocTicrioo»— ^-^Lnvo;tinr-T-r-Lnrsicricna%mro(n'— T-»— T-rsi»— ^o'^^ininr'- 
(^j  (N  <N  (N  CN  r^  o «-'—'— rsl  r^  ro  r- o  t- ^ '—»— T- T- T- cNj  rvj  i-r)  rn  ^— r- (N  r^j  cs)  CN  o '-'- <^  oo  rr^  r^  o  r^j  rg  rn »- r- r- r- T- 

I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I 

rs(NCN(NCN(Nrncorriron^rof^cymmmmuou^minminuomvo^vovovosor~-r^f^r»r^t^p-cococococT^c7^ 
oooooooooooooooooooooc^ooooooooooocsoooooooooooooo 
I  I  I  I   I  I  I  I   I   t  I  I  I   I  I  I   I  I  I  I  t  I  I   I  I   I  I  I  I  I  t  t  I   I  I   I  I   t  I  I  I   I  I  I  I   I  I   I 
o^  CT^  a>  cT^  a^  a^  CTt  o^  en  o>  cT^  a^  <J>  o>  cr>  cTi  o>  CTi  o>  o^  en  en  a^  en  C7^  o^  o^  o^  o^  CJ^  a^  en  a^  o^  en  o^  o^  o^  en  ^ 
r^  r«- f^  r^  r»  r-- 1^  r^  t^  r- r^  r^  r^  r-»  r^  r^  r~- r^  r^  r^  t^  r-' r*»  r^  r^  r^  r^  r^  r^  r^  r~- r^  r*«  r-»  r^  r^  t^  r^  r^  r^  r- r^  r- r^  r^ 


=toincnmr-o=}'COoo(T(mo>oomoor^ooo'— ^>sor^^cnr^oo^^omvomt^a3mu3r-c3^cnM3incNOcr>cn 
MD  r^  m  CO  CO  m  ■:a- 1^ »- 00  in  o  ^o  r-- r-)  CN  en  cr>  ^  ct  T- in  ^  en  ^  U3  ^  CO  rn  CO  en  <N  00  00  o  CO  00  r»  r>  ro  CO  en  ^  U3 '^o  >^  r^  en 
r-T-rna3rsiocNT-T-ooooenmrsi'— mcosi)r-orsicNmen(Nror-r^vi3rsim(NmcNrsjrs)(^mLOT-o:Trroo4r--»— ^oo 
(N(NOfN(N(Norsjoo"X)(N(Nin{NCNOommou)o(NmLnm<Nom(Noouiinmmoor^omr-oor*v£im 

I   I   I    I    I   I   I    I    I    I   I   I    I    I    I    I    I    I   I    I   I    I   I    I   I    I    I    t    I    I   I    I    I    I   I    I    I    I    I    I    I    I    I    I   I    I    I    I 

r^  r^  CO  r^  p"  r^  00  r*- CO  uj  u )  r^  r^  en  r^  r^  oj  CO  en  o^  00  o^  CO  r*  cr>  o>  cr»  (^  oj  o^  r^  00  cu  cri  cr>  CT>  cT^  03  CO  so  uj  u -t  \^  oj  oo  s^ 
i^  r^  r>  r~  r^  r^  r^  r^  r^  t^  r*>  r^  f^  r^  r^  r^  r-«  r^  f^  r^  r^  r^  r^  (^  r^  r^  r-- f^  r^  r~~  1^  r~  t^  r^  r^  r-- r^  r^  r^  r- r^  r^  r^  r^  r^  ^ 


coeno'— (N(^a-msor>a3cr>c3T-rsirn^mvot^ooo^o»-<Nro^msor^cocT>or-<Nrn:=rmu3r--coeno'— (Nro^m 
'-ovor~r^r^p^r>r~r^r^[^r^a3oou3cooocoaococooo<Ti(Ticncncr>o^cncricricr>ooooooooooT-»-r-r— T— T- 


70 


3" »— r^j  ^S" ;  N  vo  ^X3  (^  ▼— r«- CNi  CO  ^  o^ -o  ^  u^  p~  ^  r^j  r^  r^  o^  T— r^  vO  cc  en  vo »"  CN  r^  ro  rv)  rn  ro  fO  (N  ^a*  o  o »— L^ 
r-  (NfSCNjT-     rs)         rsi  (N  rn^"  -■*  cn  r- 


:*  CO »— ^  rr  ct  ro  r^  o  r*' f^  en '~  00  <^ 'XI  in  03  u^  o  r— fv^  LO  c^^  (Ti  t^  cTi  r- r^  :^  r~»  =r  CO  rM  tn  rsi  ro  uo  ^  i£)  r^ 
un  r^  rsi  (J^  rsi  ro  o  00  o  00  iN  rsi  CO  OD 'JO  ^  en  (^  o>  r^  o^  in  CO  r^  00 »- 00  CN  CN  CO  un  CT>  no  Ln  o^  o  33  CN  (^  <— tn  v£)  r^ 

CTi  lo '^o  r- csi  ro  a^  <>i  vo  t^  csj  vo '— r^  u^  (N  ^  (N  00  o^  ro  lo  ^  =r  t~^  vo  r^ 'X>  ^  o  =r  u^  o  rn  cr  r~  vO  3- o^  o~)  ^ 
cror^u^onror^r^oooHiPooLn^— ^CN:*orsicr  aD<^uoLn  00  =ro^  CO  r-oooPO^Nrn  ocoou^(7>  in  (N  CO  MO  ^cnjpol^ 
no  p^  T— f  ^  rn  cj  rn  ^~  T"  CO  r^ '"' en  ^- CO  3- r^  rsj  po  3- CN  cr  ^  cN  ^  p»> -^^  cN  ro  no  a>  uo  o  cri  u  ">  a>  ^a- iT)  o  rs|  p^  ( -^  TO 

1— T-       m      r-r-r-ajrn       U")  ^fN  ro  UJ3-      CM  POmr-  CN       r- 


CN  (N  tT)  cr  ro  (N  Cf  03  rsj  :*  r»  v£)  ^  ::» (N  r-»  lO  «- O  03  iri  (N  O  in '^  r^  OD  00  Cn  ro  (^  ^  UO  rsl  IT)  iJO  r- r»  ^  :j  M3  r- o  ^  t^  r^ 


O^-OOOt-OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOt-t-Ot— r-OOOOOOr- 
rvl  no  ro  f^^  CO  r- sr  cf  ^  :3- ^  «- ^  :3- ^  ^  cr  :3- =r  ^ '- :3- Ct  T- cj  :3"  ^  cr  Cf  r- rj- cr  (N  r^J  (^  ^  ^  ro  rO  r- CN  ^  00  CO «-- C3- CO 


oo*— cocopoocrioOT-oc3coLnrors)or\)couor^jo  3-o^p«~op-ounopoocs)oors)cncocooLno^oocoo 
v^ocot^otTioi^ooooo^cTi^'^oo'^cricor^oocooLnt^ocO'— vx)Oooor^r*(NcoLOc3-or^o"3'Oocoro 
'-ooco^o^^J>^D^>•coovi3  03co^~»o^^cnvOT-■o^cor^covX>o^oa30Lnr^ztooon^coc^Ja3co^oCT^o=J■CNocOl"o 

o  :*  uo '— CO  "^  a^  o  f^  rsi  o  ::t  cT^  cTi  MO  U3  ^  r^  r^ »— r^  vo  ^  =t  uo  uo  iT)  o  r^j  no  en  CO 'X)  en  o^  o  rsi  en  r^  CT\  r^  CO  o  CM  lo 
r^  03  CO  r*- 'Xi  r*  no  cvj  CO  r^  lo  r^  r^  lo  00  00  ^ -13  00  *- CO  ;:3- CO  CO  r^  T— MO  in  o  cni  o  en  r^  CM  r^  :3' csj  CO  ^  cN  en  CO  csi  T- 43  ^ 

<N  rs) »- 00  rsj  r- no  o  o  uo  ni  vo  CO  en  p^  n^  in  r^  (N  no  o^  no  ni  (^  03  ^  CO  CO  ro  r^j  ^ -3- M3  r^ 'JO  vo  CN  ^  en  Csl  uo  CM  r»  r^ 
r-  m      '-r-*— oSfN       cj  in  CN  in:*      r-  mrOU3  CM 


O  O  r^  CD  Cn 'sO  ^  CO  CO  CO  T— UO  UO 'X)  00  UO  in  O  ^  ;J  r- vo  ::t  r- (>J  O  CM  IT)  O  O  O  CO  UO  CO  CO  Cn  cn  <— CO  VC 'sO  Ln  CT  CN  C3  O  iT ) «— 
Cvl  rsl  (N  CM  r- o  r- CM  CN  CM  f  O  CM  «-■  rsl  O  CN  T- n-)  CN  fN  00 '— '- 'N  O  CO  »- rsl  r- ro  CM  O  T- r- »— T- T- CN  fNJ  CM  CN  O  O  »-- no  CO  O  CM 

I  I  t  I  I  I  I  t  t  I  I  I  I   I  I  I  I  I  I  I  I  I  I  I  I   I  I  I  I  I  I  I  I  I  I  I  I  I  I  t  t  I  I  I  I  I  I  I 

a>  en  o^  <ri  o  (N  c'^  CN  CN  CN  CM »- CO  00  cj- ^  00  en  o  CN  CN  CO  in  in 'x>  M3  00  00  en  en  r- CM  CN «— »- »" '— ^" '"  CM  CNj  no  ro  CO  no  CO  ^  ca- 

0000<~'— '~'~^'— »— OOOOOOCD^-t-T-OOOOOOC3C3C3T-r-T-OOOOOOOOC30CI>0  0  00 

I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  t  I  I  I  I  I  t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 

cricnencncncn<Ticnencncnoooooooooo<r-»-T-r-T-«-T-T-r-T-r-^CMCNrMCMfNCNCMrMrMrM(NCNCN(NCM 
r^  P-- r^  r*- r^  r~*  r~  r*  r~«  r^  r^  00  00  CO  00  00  00  00  00  CD  00  00  CO  CO  CO  00  00  CO  00  CO  03  00  00  CO  CD  00  CO  CO  00  CO  CO  00  00  00  CO  00  00  00 


O  O  r- Ln  ^  CTi  CD  VO  UO  CM  r*>  CM  ::*  UO  r- UO  in  Ln  r^  T- T- »— U3  rt  CT>  UO  :^  :rr  no  ■=t  T— CM  r±  XI  r^  no  »— r^  O  CTl  no  CTi  00  Cs)  en  CO  in  CO 

r^OMOX)cninoocN(NenocNr-LncoocM»-incocMincM-=r'— u3^en(Nr^oo^r-cMCNr~'^oco3-'sO'— oocncNoocrco 

in  Cf  C3  T— 00  en  UO  T— ;:r  ^  XJ  O  CO  X)  MO  CO  UO  r»  CN  in  :3"  r^  r~"  O  MD  CN 'X) »"  O  r- :3- CD  O  U3  X)  r- T— MO  CO  r»  r^  U  "I  ^  Mj  (^  XI  in  M3 

lnl^)^^llno^MU~lCMOooor^(Nln^J^1CNC3^cncnlnu^crlCncNU'coencou1a^oocnc3^eno^o^cncnoo'llncDencncooo 

I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I 

cnu>r^cnujr^<x>r*couja3a3>^r^cntnr^ooou"icnoor~'<-n»— 1:>'— cnoauoooooc)r-oc3aoo(j\»— oor-^- 

r^  r~  r^  r^  r^  r».  r^  t^  (^  r^  r~- r^  r~- r^  r~  r^  r^  CO  00  00  r-- r~~  CO  CO  r~  r~  00  00  CO  r^  00  r^  t^  03  CO  CO  CO  03  CO  u3  r^  GO  r-- 00  CO  CO  00  CO 


'O  r^  CO  cTi  o »— CN  no  ^3- uo 'X)  r^  00  a^  o  ^  CM  00  ::*  in 'X)  r»- 00  en  o »— CN  no  :*  in 'o  r^  CO  en  o  »- c  M  oo  :3- in  MO  r«- CO  en  o  r- CM  CO 
r-'-'— r-rs)(NCMcMcMCNCN(NCN(Noococononooonocoooooc3'^^ct:d-cr^^^^LninLninLninLninuoinx>x>x)MO 


71 


rv)  oD  t— rn  =t  03  in  lo  r~*  ^  *— a>  r- u^  r*»  :3' o  :*  o^  tr>  o  =r  »£>  r*»  in -J  rsj  r^  no  03  o  T- n^  T- CO  o  r^  o  o  ij^  :*  :*  rsj  vo  u^  u^  rn 
ro'^Lnr-u^^^LnoDr^Lnf'-'— u03-CT^ocN^^oaDroor*p^cDOcnu^Lna>OLn(^cro<T>roLnu^oo^ 
f^cra^^^(Noc^lv^r^a^Lna3co^— vor^ocTiooor-LO"r-^oooor^rs)oror»cor-oco»-o'^ti^o;crcooL^ 

CO  03 1^  uo  f^  o^ »- T— r>- CA  o^  r*»  *£>  un  >sD  uo  u^  ■:t  (7^  Ln  o -It  CT^  rn  cN  uo  (N  ^  u^  r^  vi>  o  <— f~o  o^  ct  OT 

»- rr »— en  f^  r- r^j  (N  ^  ^  in  (Ni  ^- vO  vo  r^ »"  o5  cN  r^  (N  uo  CO «~  00  en  :3.  Ln  ^  (7^  o)  o>  T- uo  o »— 03  CO  t^  ^  csi  ^  ^  r^  ^a' Ln '^  r^ 

3T\)no^OO:3-rno(^<^"J'~"f^CN|T-o^CO:3-Ln(NLi)rr)rr)^Ln^c3-  o^rNj^"'—  cot— vX3rMrs|n  i-r)0-) 


r^  oooro  (N  ^<^  lO  p^ »"  in  vo  in -^  in  r^rsjc*  00  in  ro^a3  en  \oor^:a-<N»-<N^'-<^<^<Nrn(N  CO  T-^rsrsi^f^^ 


0000ir-000000r-r-00000T-0000»-T-'— '-OOT-OOr-OOT-Or-oOOr-T— OOt-t-t- 
CN  r- 1- it  T- cr  ro  ::*  ;a- ^  ^  ni  (^  ^3- r- CN '- »- «- cr  ;;f  ^  no  r- ^  :3- no  ^  T- r- T- T- rs|  *- *- fN  3- T- ^  r- T- T- og  ^  T- »- CN  CN 


rsja3crir>»onooor~»or»r^r^o3r^qooor^rvj:3-T-'— o3orsi'^D<Nr^a3cn(Nnono^ooooinLnr^oo^LnooPo 
po\^^roonor-oesjo^r^novo:3-ooof^rsiLnor*coorsj:3-nor*>Lnp^MDinor^oPO^OLOoa3o^cno'— p-» 
p^coo^(NQOcooo:*ocT»r^jvoena^ooor^a30ror^'~^^e3»— r^ror^or-r^(j^ctroT~Lnco<-o>^cncofN(Nr^r^ 

OGOOr-o^^^'r)<NoocrLO•=^r^a^o^^^Lno3<N^n^otnno^-^^J^^^r->r^r^^^J•'— cop^^c^^^^^Jr^or**o^cnvo=Tro 
^  r- ^ »— 03  00  ^  o^  r^  cTi  CN  vo  no  (N  Ln  lo  T- esj  r*- r^  o  oD  rs)  :3"  (N  <^ »"  o3  no  o^  03  r-» »— »"  en  cTi  r^  r^  V42  ^  03  r- r^ 

mcN(N=rcncNnooo3Lnrnr*onorMT-cncono^{N^no<N^^aTO  nors  rsj'— inrscNCN        noro 


(NincN^^onoo^ot^o'— ^^r^LnLnin:3-o3inno^ooro'-vorsiLOcncneni^r^r-cnnoinror^a^onoronor-T-- 

(NO»-0(NnoCNrOOnO<Nnon-)r-ogo^OT-OOfNCN<N(NoO'— fNrsieMCNCNOO'— rsJCNT-rslfNr-rsJCNOrsjnonO 

I  I  I  I  I  I  I  I   t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I   I  I  I  I  I  I 

■=t  in  in  vo  vo  ^  r^  r~>  03  en  rsi  CN  00  en  o '— r- cN '— in  r^ -i^  (N  r^  ^- cs  no  cr>  a^  o^  a^  en  C7^  ^— '^  T— (N  cNj  no  no  cj  f^  r^  r^  CO  CO  CO  CO 

OOOOOOOOOO'— '—OO^T-T-,— OOO  OC30000000000»- '—»-'— ooooooooooo 

I  I  I  t  I  I  I  I   I  I  I  I  I  t  I  I  I   I  I  I  I  I  I  I  I  I  t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I   I  I  I  I  I  I 

(NCvirsir^  CN  rsi  <N  CN  cN  r^jr~«  f^  CD  03  03  CO  oD  oD  en  a>  o  o  »~  r- (N  (N  e^  CN  03  00  03  03  03  CO  00  03  03  a^  en  en  en  en  en  en  en  CT^  en  a^ 
CO  00  CO  CO  00  o3  o3  o3  00  CO  p^  f^  r^  p-N  r^  f^  r^  r*- r^  p-"  00  00  00  o3  o3  o3  o3  03  r>  r^  r->  r~- r-- r^  r^  r^  t^  r^  r^  r- r*- r^  r-*  P-- r>- r^  r- (^ 


r^j  in  ^- vo  ♦"  »— cr*  r^  cr  o  o  rsi  P~  :*  no  <N  CD  r~- no  no  ^3- o  <— c^j  o^  no  o  o  CO  cf  o3  (%i .— og  ("^  f>^  f— f^  o  r^  >X)  o  r^  r~- o  rs)  r- rn 
P-- o  »- r^  en  (7^  no  en  p-- en  CO  p-.  in  T- cs  T- rsi  p^  in  no  P^ -ra- ^  CO  p~  00  in  o  ^  in  C3- u3  CO  rs)  vo  ^  ^- r^  p~  no  no  r- >sO  vx)  p»  r^  o  o 
mMj(S^in(Ncj>v^>^:d"OctnoififNT-crononou)oor^p^cNr-ononofNnocnu-irs)u  'oooajr^T-noci-cNmr^uT3-:3' 
ocoooa')LnooLnooincMrNinoorNP*rsifN(NOoi'>incricninaoooocNOOo(NinooinoomLnir)inoo 

I   I   I    I    I    I    I    I    I    I   I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    I 

»— '—'—o>  ui»— en  rs|(Nu>rN  r^(Ti  CO  CO  p-^P*  p^  P-.  00  o3  en  cnootnr-oj  (I)  u3r^ajO30u  p^o^  GO  uj  en  CO  CO  en  en  (J -lu-i  00  00 

CO  CO  CO  r^  p*- CO  p^  no  CO  p^  p~  p>- r>>  r^  p»  p»  r^  p^  p^  p~  p»  t^  1^  p~  CO  00  r»  CO  p^  r^  p>  r^  r^  p^  r^  p^  p^  r->  r^  p^  r^  r- r~  r-- P^  p*  r^  p^ 


::3- in  \x)  P-- 03  o^  o  T- <N  no  ^  in  vT)  p^  03  en  o  r- nsj  ro  ^  in  vo  P>- CO  CT^  o '— rg  no  3- in  »X)  r>  CO  en  o  r- rsj  no  ^  in  *X)  r^  CO  o>  o  r- 
v£)vOvD'^>X)^r^p^r^P^r^p>-r^p>-p-p^cocoo3coo3coa3cocococnencr\cncn<ncncncnenoooooooooo»-T- 

^  T— T- T- r- T- »- r- ^  r- r- T- 1- T- »- r- T- r- r- T- r- »- T- T- »- ^  T- T- 1— r- r- r- T- T- 1— T- rsj  CN  CNJ  rsj  CN  rN  CN  (N  fN  CN  CM  CN 


72 


1— OOOr-OmOO'-T-'-000-^«— O^rnT-«-P0CNT-LnO«— CTi^-CNO'— 0«-CN(N»-fN'— OlTH— O"— <-OCN 


vT)  <▼!  a>  (N «— o  a>  LO  lo  p^  00  03  r- on  03  r- tn  o  rs)  r- o^  r^  ro  o^  r- r- o  r^j  T- sO  t^  rn  ro  00  LO  u^  CN  ^  ^  (^  cT^ 
(N'vOOu~)ooo'^»— ro^r^or*a3uocnr>«roor-*(NO^cri^u^aD(-oo^r-T— ^vlOlna^o^fn'— cn^-oo^o^osro 
r- rsj  CO  a^  r^  >X)  (N  cT  ^  ^  r^  r\i  in  a>  u^  (^  cr  sD  i-n  rsi  T— r~- in  r^  rn  cs)  ^  r^  lo  f^ '"  en  r^  oD  ro  rsi  OT 

ovou^OLnoLno^aD:d'oaDr~-i^o^t^:d"r^cnvo^^3r^or--ro(NMOoa^Ln=r<— a3<N^vDC7>Ln^ir>T-^ 

in    a^;t^r^u^fNr^cT>co>j300voaDO^uDvor~crior^^\x»roror»incoctv£)     u-)CNr^cncN^T-fMror*-ooior^roLn 


rn(N  on  ^  cvi »- rsi  in  in  rn  01 00  ;3- rsi  ro  r^  :3- rvj  r- CN  rsi  (>i  ^  fN  CD  ^  =r  T- (N '- u^  ^  o^  ^^  f- ^  o  rv)  vo  o  r^  o  MD  u^  =r  c^ 


OT-OO^OOOOOOT-Or- T-T-OOOOOOOOOOOOOOOOOOOOOOr-O'— OOOr- t-Ot— 
a- »- ^  r- 1- «- CM  T- :3' T- r- T- r- rs  CN '—'"'-»-"—'- ^  »- ^  ^  ^  :d- cr  ^ -a- T- :3- '-'— ^  ^  »"  ^  (N  <- 00  ^  cf  T- cj- :3- *- CJ- 


Oor-*OoOO'XI'vOOOOr*OOOCTiCNOJu-)=toaDol*^OOiT>OT-r-pr)OOOOcrOOOCOr\)cMnLn(NOO>-00 
00<TiOOOLn>X)vOOO(N^O=tOLO^O(T>^O^OvOOLOLnOor-~oo05=toa3T-rMCMT-a3a30-tOOa30 

c7>o:*o^ouDooa^r-r*-cr\\ocooa3  0::*^Ln(TiT-cnaDooor^Ln^orsiLnuoaoaDoooocn:::tinr*t^^\i3ro 

:=f  rn  r^  ^  00  o  ^  ^  00  o  T— rsi  :3- o  r- uo  ro  rvj  r*  o  CNj  rsi  r^  in  (N  03  oD  in  in  OS)  (N  fN  00  ^  v^  o  OD  r~  CTi  vo  CT\  TO  a^  ^ 

00    aDcNoor^cjr-o'^vorN)^Lncor^un^3r^a3oo'~cNoooi-OT— mouo     cn'~t— o  03003  r^cN^r^'— or^rocr* 

fS'-'~      T-a-OD  00  »-a>«-cN'-r»'-rN      »— CNiO  ^»-      rOCOOO      »-      oovOCN 

CN 


o  cf  r- r^  03  03  03  03  03  oD  CO  03  03  C7>  en  en  00  in  v^ -vD  vo  o  (T^  IT)  ^  in  in  r^  >o  uo  CO  a^  en  r>  00  IT)  >^  t~^  C5  Ln  in  >sD  ^ 

T- »— (N  CN  (N  r^  r\l  rsl  r^J  CN  r^  rs)  CN  «— T- »— (N  OS  (N  fN  <N  O  O  »— »— rsj  (N  (N  O  »- CN  (N  T— (N  ^  r- T- CN  PO  o  o  o  o »- r- <— 00  00 

I  I  I  I  I  t  I  I  I   I  I  I  I  t  I   I  I   I  t  I  I   I  I  I  I   I  t  I  I  I  I  I  t  I  I  I  I   I  t  I  I   I  I  I  I   I  I  I 

C3^  C7N  en  (x>  c7>  en  en  C7(  en  cTi  ctn  en  <j>  o  o  o  o  o  o  o  o  o^ »— CN  a^  a^  o>  en  r*>  3- ^  ^a- uo  in  r^  r^  r*- r~  r*  03  00  CO  00  00  CO  00  00  cx) 

OOOOOOOOOOOOO*- '—'—»-'"'—'—'- C:>r-<r-0O0OO00OOC^0C:3O00O0CD00  0OO<-J 

I  I  I  t  I   I  I  I  I   I  I  I  I  I  I   t  I  I  I  I  I   I  I  I  I  I  I  I  I  I  t  I  t   I  I  I  I  I  I   I  I   I  I  I  I   I  I  I 

cna^encncno^(:ncnc3^cncncT^cncncncncncncncnc^^oocncnoooOT-cNCNCNCNCNCNCNCNcNCNCNCNCNcNC^)CNCN(NCN 
r-»  r^  r~  r»*  r*  r^  t^  r^  f^  i^  r^  r~  r^  r^  r«.  r^  r^  r^  r^  r^  r^  r^  f-^  t^  oD  03  CO  00  CO  00  00  00  00  CO  00  CO  CO  03  00  CO  CO  00  CO  oD  CO  CO  00  00 


00  CO  v^  CO  o  in  03  CO  vo  cs)  CTi -rt  ro  00  en  P-- T- MO  CO  ro  o  o  >>o  03  r^  CO  (N »— vT)  r^  00  rvj  (N  (N  CO  r^  CT>  rsj  *— CO  CO  r^  f^  CO  =!■  00  o  CNj 
cov^cNCNrooocnvocnr-cj^in'— T--incooocr^oooco^Lnr^r*r^o^'— cN<N=J■(J^»-r^luo^u3lnoo'X>^^o^ 
ror<»Lnu>cjr^r^crLOui:3-^cnvwr*c»inr^^3'incT>oo'^^orscNcocuof^xO'~oooT— u;icroor^:3-«— '>&a3cuoo'^ 
inininixiou^u^uoininuoinLnu^incDuooooinouooincT^cncncT^oooaoooooocnoocooococnencr^aooooo 
I  I  I  I  I  I  I  I  I  I  I  I  t  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I  I 
o^cna^o•^cou'>c^o^cr^o^cn(J^(J^CT^cncocn<IJcoooc7^oocno3cnoooo'— cN'~'~rN'— OCMCN^— »— t-i-jc^cdt— T-fNCN 
r^  r^  r^  r~  r^  r~~  r~- r^  r- r~- 1^  r^  r^  r~  r^  r^  r^  (^  r~  r^  r*  r^  t^  (^  t^  03  CO  00  03  oo  00  00  CO  o3  03  CO  CO  oD  oD  CO  00  03  CO  cx)  CO  CO  CO  CO 


CNro:*inor^coeno»-CNoO::*invor~-cocno'~fNoo;3'in^r^oocno»-rNoo::*in^or>cocno'— CNro^in^r^cocn 
»- r- «— »— T- 1- T- T- (N  rsj  Cn)  CN  CN  CN  CN  CN  (N  CN  00  00  00  00  00  00  00  00  00  00  ::^  ^  cj- ^  cj- ^  :d- ^  cj- ^  Ln  in  in  in  in  lT)  in  in  uo  in 

CNCSCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNrNCNCNCNCNtNCNCNCNCNCNCN 


73 


r-r-T—00(NO=J''— r-rslCNT-O'— OCSOOOgOcf— T-OCNr-CN'— CM'— CN'-LnrNr-rOCNOrsl' 


^^  C7>  in  T- on  f^  CTi  (N  o^  03  00  CO  oD  p*- =r  ^  rsj  rs)  o  r^  LO  u^  vx)  ro  •— f^  o  ^  rt  ^  CO  ^ '^  CO  r- rvi  r- o  in  o  r-- 
cTicrir\)r4^c>^o(Nnr)crir-r-T-T-^0::*»-co^:^r~o^'— OfNror»^rnpor^T-<ncrio^«— Or- 
po -^  (^  o  ^  oj  v£)  CO  r^  in  rvi  vjo  T- un  03  r^  in »- rn  T- r^  u^  in »— r^  CTN  cr>  en  in  r^ »- ON  o^  CNi  3- '- in  oD  03  o  ro 

inr^^r^T—f^rsiof^o^t^T-r^inT— inT-oco(^t— r^v£>^ocr>^corsi'— T-ocorsico-:i"r~criu-)r-\^ 
rnr^fNCsiot^vo^cnr-'— Ln*— cnr*r^(NjLna>(^r--u^r-ooor>.rnrn^\o^o^oo:*rvjr^rs)ro(Nco 


^  ro  p*  it  cN  r*»  lo  crt  >^  ^  NX)  in  :*  r^  \£)  cT>  ^  00  ^  in  ^  po  in  ^ '^  ^  ^  v£)  (N  r*  no  ^ ,— T- <7^  f— ^  CN  cTi  rsi  tn 


T-r-OOT-OOOOOOOOOOOO'— r-r-r-«— T-O'-OO'— OOO'— 0  00»-0  00»— '— 
»- CN  r- T- rsj  ^  :3- :*  m  :=r  ^  =r  on  n  T- T- 1- ?- r- T- »- C3- ::3- T- :3- »- »- CN  r- r- T- =t  ^  :*  ^  ^  cj  ^  SJ- r- ro 


r^rsjooo:j^oooc'^oOLnLnpocrirr)oooooo(TiooocoaoovooT-MDOPOoooooo 
(Nop-»ooi-nooinmrnror»:d-cocriunx)OoooocriorMo=tr-r-u-)or^u300oooorNj 
pno^cooin(Ncocoin^'^x)oo:3-cTi«— criocria-orsjcoGoaooo^a-cTir^'— Ln^o^^criO'X)^^}- 

p-~ «— ::*  en  c7^  rvj  rn  r~  vx)  ro  rsj  r-j  00  rsi  ;3- CTi  psi  ^  ro  (Ti  ^  T- rsj  rv)  in  cN  ro  CO  T- r^  r^  o  CO  r- c3- no  vo  ^  in  r~- CO 
CN  o  p» «— o^  u^  in  r^  CO  r*» «— T- CO  ro  rs)  ::j  T- ^n  CO  CT>  in  o  oD  ^D  03  CO  cT>  o^  CO  cN  ^  rs  o^  r>' po  o^  cj- (N  cN 'X)  \o 
(N^  cN^cN  T-T-r^  \X)  mm    cr^'— »- 


OP--'— ropomnror^cTiooooooooooooooooooooooooooooooo 
ro  o  r^  Cs)  CN)  rs)  csj  rs]  (N  CN  <^  ro  ro  c^  rn  (^  r^  rn  00  00  no  (^  oi  (^  ro  ro  m  rr)  ro  po  00  (^  (^ 

I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    t    I    I    t    I 

CJOOOOOOOOOOOOOCJOOOOOOOCDOOOOOOOOOOOOOOOOOO 

I    I    t   I    t    I    I    I    I    I    I    I    I    I    I   I    I    I    I    I    I    I    I    I    I    t    I    I    t    I    I    I    I    I    I    I    I    I    I   I    I 

csj  (N  rv|  CN  r^j  <N  r^i  cv)  (>i  r^i  r^i  r^i  rvj  r^j  (N  (N  OS  <N  rs)  (N  r^i  <N  <N  (N  o^J  (N  oj  CN  rsj  <N  OM  rs)  (N  (N  OS  (N  rsi  (N  rsi  ^ 

CO  CO  CO  00  00  00  00  00  00  CO  00  CO  CO  CO  CO  CO  CO  CO  CO  CO  CO  00  00  00  00  CO  CO  CO  00  00  CD  OD  00  CO  CO  00  CO  00  cx)  CO  00 


(N  m  vxi  :d- ON  00  T— p^  o  CO  r— CM  >X)  o »— »— oo  ^3- m  =r  m  o  oNj »— rv)  oo »— vo  P^  ^  cri  in  o  m  o  r^  r-- ^x)  >x>  m  cTi 

<0  *X)  t^  on  r- OS)  CN  r- 'X)  CN  »- T— OO  :3- OnI  00  ^  r- ct  CS  m 'X)  ^  rr  a- «— r- m  "Xl  VO  ^  ^  00  vi3  O  r- O  O  P^  M3  O 

CO  Of  1  in  r^  on  X)  ^  vo  uj  ro  o  p^  rs  r- no  ;:r  v£)  r-- ^  p^  OL)  vx)  CO  T— CD  \x)  o  ct  w  00  ^x)  ou  o  r^  r-- CN  cN  r- OS  CO  p-- 

OOOOOUIOOCOOOQOOOOOOOOOCOOCOOCOCDOOOOOOOOOOOCOOOOOOOOOCO 

I   I  I   I  I  I  I  I   I  I  I  t   r  I  I  I   I  I  I  I  I   I   I   I   I  I  I  I  I  I  I  I  I   I  I  I  I   I  I  I  I 

T- 1 N  T- CN  a^  rs  (N  T- T- T- CN  CN  <N  ON  <  N  r- CN  »— (N '— CN  «- *— T-CM  r- r\j  CN  CN  t— CNr- ON  (NJ  C  N  CM  ON  CN  OS  CN  »" 

OO  CO  00  CD  p^  CO  CO  CO  CO  00  00  CO  00  00  CO  00  CO  CO  CO  CO  00  CO  00  00  00  CD  00  CO  CO  CO  00  OO  00  CO  CO  00  CO  CO  00  00  CO 


o »— ovj  m  c3- in 'Xi  p^  00  en  o  T— OS  on  :d- m  vD  r- CO  cTi  o  T— onj  on  cf  m  >^  p^  CO  en  o  T— oxj  m  ^  m 'X)  p^  CO  o^  o 
XJX5^x)^^X5vX)^vox>p^r^^^^^^~-r^r^r^^>r^cococococooooococococ^^cncno^cr^a^c7^a^c^la^o 
CN  CN  r^j  CN  CN  rs  0--4  rs  ON  cN  r^  CN  rsi  CN  ( N  OS  ON  CN  CN  CN  OS  CN  cN  osi  CN  rs  rsi  ON  OS  OS  CN  rs  CN  CN  CN  fN  CM  OS  OS)  CN  on 


74 


en 

JC3 

+J 

U 

fC 

> 

t-4 

•3 

'O 

m 

M 

w 

O 

COCD:*Lnr-r-aD^       I^  JD       C7^  >>C  CN  ^  lO  O  CO  v£)  ^  r- OD  ("O  ^  ^  CM       O^rTCNr^'-r-CTM/^POCTiO^  3•(N'— 
'^^v£)CDLnLnaMr)'~0^-  :3-OLnoui'-or~o'~^Lr^OLn-3'--*Lno(Noor^Lr)OT-Lr)u~)0(Ncr.r>.rsjrn 


^rocx).— <N>^Ln(Nroco<^v£)^(^rncNLnroir",OT-'-<Tir-^pncorNi^oo(N«— ^O'— cNr*-o  ocn  ^<j\ 

a^r-OlrlT-cr^aD^a^r^vOO^OO(Nrtl^OOO'^OCnr~CO^OvOUDO^OcT<Nf^r-^-)a^LnOa^<J^\£)(N»- 

^^<— Ln  a^  03  lO^-o^^^rsjT- a^ui«—or^  CD  T-ou^'sDu^^  ;Nr>- in  CN  CO  r^uTOa^LnLnr^cN  en  sOCsiPo 

rvl  T- CU  VX5  ^  O^  T- CN  »— CN  r^  O  »- VO  rf  1  ro  VX3  ^  U3  »- Ln  O  rn  CT>  \X3  n^  r- (N  CN  o  o  r^ '— CN  «— ^  ^  in  cu  vo  rr  «— 
^«—   I  f^         I  CNCN  CN       CN       »-»-  r-         I  r-       T-  t- 


^  r^  on  ^o  <^  cr  1^  o  <^  cTi  ^  T— r>- CO  r^  ^  u^  cr  cTt  r^  CO  (js  :a- CO  o  T— r~~  rsj  ro  VX5  CO  o  r*«  ro  T- cj\  cT^  (-SJ  ro  ^  po  in 
o  r~- o^  :r  r~- ^.o -^  o  CO  T- cr  cj- ^  fT)  0-)  un  ^  o »— csj  o  CN  ^  (^  un  r^  CO  C3- cTv  CO  r>- (N  o  cTi  CN  ro  r*- ^  <Ti »— o  cr 
lOfo  r^  un  CN  r^  p-«  o  o  \X3  o  ^  CO  C7^  CN  oD »— in  CN  r^j  C3- -3- r*  it  o  en  in  in  vo  CN  >^  r^  00  r- MD  CT")  JD  vo «— ro  in  cr 
T- r*%  n^  t^  o  o  u^  o  00  on  CN  »- UD  o  ^  in  (N  \x)  on  C7>  CO  CN  r^  csi  cTi  CN  in  ^ '— ^  r»  r>- nn  00  CTi  in  o «- rn  c^  ■=}■  r^ 

T— CT>  O  en  O  O  r~- en  r*- f^  O  CN  ^"  r~  0>  CN  O  in  CD  00  en '— CT^  O  en  00  CTi  O  CN|  cr,  CO  CO  O  CTi  O  CN  r- cri  Ci  r- C7^  T— 
r-Or-0'~»~OOOOr-(N»~OOT~^~»~00^~»~0'~000»~T~OOOT~OT~^~»~0^~^~0»-- 


CO  CN  lO  ^  on  on  lo  <7i  r- en  r*«  vD  in  :rr  T- CN  on  vo  on  en  o  00  r- 00  00  CO  ^  r»  o  00  o  cn  >x)  CO  in  en  on  r>»  CO  <T\  00  T- 
in  CO  OMn  f^  on »— 00  f**  ^^^ '—'"  CM  o  ^  rsi  CO  on  r^  on  00  00  CN  (^  m  en  lo  r~  on  o «-- CN  MD  o^j  r- o  T- (T>  r~- o  cr\  CO 
r^  in  on  ::*  ^  r- T- 00  ^  (j>  ^  on  o  »- on  ^  00  p^  cTi  r^  ::*  in »~  in  r^  CO  en  CN »— CO  on  on  un  un  <J^  r>»  c^i  r*»  r)  vO «"  on 
oonr-=j-(j^criCT>»— o^onvoLnoncor^^inzrcoor-»^vor3-o:3-::j-<Non:3-cnono^or^ocoir>r*oncN 
en  oD  CO  CO  r*»  cTi  p^  C7^  (J^  r*- cr.  en  cT»  cr>  cTi  T3  C7^  CO  t^  CO  a^  CO  r^  00  <Ti  CT^  CD  r~  00  CO  cT>  CO  en  cTi  en  r^  cT\  en  en  en  00  en 

oooooooooooooooooooooooooooooooooooooooooo 


a>  oa>in(Noooooooinoovx)oooo«-r*»^ooocoo:*^o^oco=t«— r^^^ooo<— r^or^ 

C3  oco<N^oooocDOOCN>^<Nrnr^or^>xi^cno^ir):d-(NoooocnoococnooocT^r-or^ 

•H  'T3     a-MjJCNcnocnocoooor-cocN^rsioovoen^cTiOT— rsjr^o^OT— r~-CN^onocrion<— voincoinon 

a  oQ     covoa>-=i"r^a^(jMnai»-in^'— '^ininrNr^'— ooc7Mnc7^^^cnonoocN'J^ln^~^^cn'— cocTi^cn^in 
•H  Ot— cocNM3vor^cNvo^in'~T-'~-^onoocnon^c7>o;3-oncn^~oncNco'^oonononu-)fTnr-r~coco(3>^ 

^  t^iNrncNm^moncN=rino')r^^moncriiNo^unv£)CNuicNrrir')CN(Nr-cri'>of')(Non<NLf)Ov^coo^o 

onrn  ^     ^'^        in     ^     »-  on    cn    on        ^-r-cN^'— 


W 

4J 

-ci 

K 

U 

M 

+J 

n3 

u 

M 

«: 

O 

\ 

+J 

t3 

w 

•H 

w 

rsj 

03 

+J 

fl 

> 

a, 

■H 

o 

s 

3: 

o 

o 

P5 

O 

\ 

na 

<! 

trJ 

•H 

H 

■rH 

m 

< 

CQ 

Q 

i=! 

c! 

(TJ 

•H 

Q> 

S 

E! 

<]) 

■u 

4J 

(fl 

fl 

a 

5 

•H 

> 

■*-> 

O 

W 

o 

IM 

m 


ovx)ooooooooovoinC5c?r*>ooooovoor^T-oooonor-ovoooOocncooocN 
ocNoocsoooocsooscNoincnooooo'— ^slonr^oooT-ocooc3•oo^cNCT^?-oco»— 
onlnovDoooo^*~fNr~»▼-cocoLnonocNOOo^— cninmono'— cooLnoo>^^LnMDr-»Lnr^cNun 

ificNinovoonr-cN-3-vornfNT-inuDvo\£)Oinin>£)cocj-T-r^r~o^cO'— incNiOCNcnco^^— r^r-onoen 
on  CN  r->  on  ^  sr  ^  vo  =t  CN  CN  ^  on «— >vO  ^  m  cri -a- CN  in  on  in  CN  en  CO  cr '^  on  en  rn  o  CN  r-~  cN  CO  r^  r~  o  in  U3 -a- 
vwcNrncNon^^rnmvo^'~o<-uoncNcu^~uju)r-u  )cn"  >cNf^)rntscNO'<ooon^oO'~rnt— ^c^n—m 

oncy  vx)     ^^        in     ^     r-  on^-on     on         t— ^-cn^t- 


a     '-rsjmrj-invor*cocno'— (Non^invor^cocnoT-fNon^Lnicr-'OocriO'-fNon^Lnior^oocno'-cN 
O  «— »— r-T— T-t— ^-r-«— r- cNCNCNCNCNicNCNcNCNCNononrnononononnnononcr^cj- 


TS 


a^p^3•r~•^^vD     »-r-r^orM    rsjr-r~(NLn»— ::j-Ov£)C0'— »-i"Nm(N^romrMoou~)^cNCNunrM(N  oo    r^r^r^o^ 
.£)  r~- r^  en  ^x>  rj  in  o  o  a>  uD  ro  rvj  o  1^  (N  in  CN  *— oo  ^  r\)  rn  cN  T- cn)  ro  CO  ^  ::r  r^  r~~  ^  03  p^  cr  CT^  in  ^  ch  r- :^  o  <^ 
r-r-rsivDcoLOooLnmoorsioQ^t^or~crior-a3o  x>:^ncr>rMcr  -rLni^or^'^oaDLO:3-fN'N'-OT-ocr>cN^Ln 

T-  r-r^  r-  fsj  ^-  T-  ^  T-  r- 


oooococorousin     "sOcdomOvo     <Tir^omoir)»-cor-T-cri-=}"Lnco(N(N;3-vOoro::rr-noor*-^crir*'ao     fN^a-^^— 
T-t-cN>J3ootr)OOtnrooocNocri^or^C7^0M30oo>^^rna)CN3'^Lnf^rocNCNOCNu^^iNCNLnt-0(j^cN-^ 


r^=ro^cn::ro^coo^>^oof^v£)Ovoi^co^ou^Lnu^vDOc^cNoo'X)a>=rcooLno^cNoo^i)u^a>ooT-ir)ro 
\X)  r^q  ro  00  in  ^  C7^  o^  p^  lo  o  rsj  a>  LO  u^  ^  CTi  r^  rn  lo  03  in  r>>  <T>  \X5  rs)  T- o  o  a>  ^  ::3- lo  ^  =t  u^  <^  o  T- :3' o  u^  ^ 
ocx3vx>cria3^^^r^(N'— roorN)oincriin^^or-p>^u^p^co«— ^^J^x>u^^cooo^Ln^^^o^^^^^lnp-.^oa3vo(No 
or^o^corsf^ooor-(NOTrsi»— rv)T— «— a>a3cr\r-ooO'— r-T— oLnr^oDo^r— cNjr\ioocTiOT-0'— cnLOcNOcoT— 


■o«- 


-Ttt^r-(Nu^vooo'oa^T-or-»ou^rncnT-^^cn^oo^^^Poa3-tco^u^o«— r^in'-cN'— (^vo^o.-^f^t^^ooctcoun 
rsja3rsioo^a>^p--or^ocno'— «— u^co^n'^^oa3lr^o^f>^:3■c^^CNr~ocrln^''^Iu^cn^sllnooror^4oo<^ 
inr^oa3rnrsiu^co(Ncrp^coo=t'— a>r-rsiocoros0^p^r^cor^^=rroa3in=t'— a3r^f^=TLno:3-»-o^co'^03-p^ 
^^Jcru^oco^lr)r^:^•vou^a^OT-r«cJlnc7^lncN^o^a^^vii(NLnr^^^<^'-r--c7^^a^o<^>OT-o^^crc^o(NL^ 
o^  CTi  CO  <Ti  ch  ON  a^  00  o>  o>  en  <T>  o  p^  03  CTi  en  p~»  o^  <^  a^  CO  CO  CO  en  cTi  en  o^  o>  oD  cTi  00  03  a^  03  o  03  a^  (7>  ^ 

OOOOOOOOOOOOr-OOOOOOOOoOOOOOOOOOOOOOT-OOO'-OOOOOOOO 


cnocD^omO'— (NocNOOoO(NOOOoooOa-cnooenooen3-oinfNoesocrio>X)00  3'niinoo 
cr»^-r-oooT-or~^o>x>fNooo(NorMrnoooir):3"T-oounooinM30ooo^or-o^o(NorJO=troT-o 
en:::fr^jinoao^(^oo'^ovO'— oocNO'— Lnoooa3-=J"v£)oooocnoOc:joor\jou~)Ocnocnoa3rrrninooro 

u^  in  CO  u^  03  (^  03  T- cooen  r- cp  00  cj  in  f^  r>  CN  p^  |>o  CN  i/^^cn  03  o  cr  o^  r^:*u^p^  CO  a>^a>  00  CNr^  en  in  ^'—c^ 
u^  o  Ln  (N  u^  vo  u^  vo  <N  in  r~- ^ »- 03  viJ  fN  ro  in  CTi  tn  cr>  in  en  ^  esi  ^^)  en  ^  u^  o^  tn  r-^  f^  o  tn  *- CO  in  r^  ^- r^  03  r^  r*> 
f^  (N  r^- r^imrs  r^j  <o  r^cN'-ocNCNvor~rri(N^^^^-=r3-u)cn  0)1^100  00  3- rnoj^a- 3- CNc-T-vocT^u^r^cN^ 

3-    T-v£)rom  T-        r^    vor^'~    ^Ln    co        rscNin  cr  ojo 


o<NOr-^oooomooovoooo(Ncnr^(Noooooooooooooina>ooooooooooooo 
op^ocri0^mooo=ro:*cnoLnrn^^oocoooooooooooc30orMOoooooooooooo<-3 
^r-rofNoocNOO'— t— o^ocno^^cnlno^^^J^-00ooooocnoooooa^oooou^OOOOOO^-.oo 

nior^<Ncor-^ooo<Nr*cN"^^ovx)r*crir^cno(Ninoooc3LOOvoofnoao(^oor^vo;3-ino<^r>'r^(Noo 

in  vo  00  ^D  r*  u^  in  (^  o  in  fN  u^  f^  in  t^  (N  r^  ^o  **  (7>  00  cr  ^  ■:3"  to  \£)  C3  ^— ro  T- rvj  in  o>  ni  vo  o  T- 03  "^  00  ♦— ^ 

ro'— r^ro^N^— OM3>^uoujvo»-<NUivo(Nr^rs4:3-uivi)Ln^croo'Xic3»-»-cNCNcnr^ro»— cr^M3t^cnT-(NfT^r^rorv^ 

:?      t-lOCNO')  t-  u3      in'"^«-»~min      n-  CNCNUO  ^  oocn 

ro  ::j' lo  vo  r^  00  cno '"  r^  no^u^  uD  r~  00  cno^~rsirocti^vot^  CO  o^o'~cNrn^u^^^^^  03  a^or-(N  00  cjin^r-- 00  cno 
:*  :3- C3- cr  ^  ca- :3- in  in  in  uo  tn  u^  I  n  tn  in  Ln  vo  vo 'X)  vo  v^  v£)  vo '^o  >^  ^  r^  r^  r-- r^  r^  r^  p~*  p^  p^  r^  00  03  00  o3  00  o3  CO  o3  TO 


75 


oor^^o  ^ot— o  'x>  coor^(N'~f^oco  ;i-o^LncjNcoir)LO-3-c}'Cor~of^aDr~rn::)-:^rsi^cocricri^pOLnOsO 
r~-or^o<^r^f^c»o<^oors)oaOT-cocoT-o^r^jot^rNro^r~-»~^0(Nroo~i<^ocri(NPOr-::tf^aDaD(j^ 


(Tif^(T>   T-fNm:^'   0>   rO^-rM;Jvor^^r^   CTi  a> fN cf  ^  a^ 00 CTi OD O OD LD 00  =r  UO LD OD r-> CN CTi t— :3- ^ :3- Cf  rO »- '~ 

vx>r^vi5  ^ooo  <o  coor~-(Nr-oooco  c3-cricNocoLnLOc3-crooLnor^cor~>r>gooaTs)3-ooocTi^orncoo'sD 
LDincTi  (Noror^  r-  o^^or*«^=fCNcrio  cn^LOiJ-^r^^T-ooo(Nr*^ocN(-vjcri(NrnLnr»r-^j30'-'-inoo 
T- o  i~*  o  en  r^  u^  CO  o  (T>  o  o  (>)  o  00 »- OT  03  r- o  CT^  cN  T- rn  <N  fo  ^  r^  T- ::r  rn  (%j  rn  o^  (N  o  00  CN  r^  r- :::?  rr^  oD  oD  a>  r^ 

«— CNCNO"^fNCNOOLnor-oocT^^-(Nc^^^o^^crT-'— cn^oino^or— Por~T-oourr)so^r»incr.T-r-r^^ocN 

|p-«  CO  fN'-lll'-r-CNr-  t-i-  r- 


^  CTi  =t  cn  r- no  T- cn  rn  en  TO  o)  CO  Ln  ^  rsj  LO  =r  vO  o^  r^  00  o  o  r*»  cN  o^  ro  cN  r*  rsi  T-«  lo  cj- f^  ^£>  r- r- o  ^  r^j  o  ro  r^ 
1/^  r*  ^iD  r- cxi  r- rs  r- ro »- u^  un  cr\  rn  <^ «— ^  ro  u^  <N  f^  cN  o  f^  rs  r^  :d- :a- o  en  CO  r~>  r*»  v£)  cN  r- oD  u^  r- T- o^ 
u30^rn<Tioc^u^orsj^T-^r^joornr— r^r^cNjr^^OTt^iO'— rnvoo^Ln'■i^T->ocnooa^^x)a^o^o^^^^^ 
r-o^or^LOP^r^inT-o^'— oD'— cor^or^o;!''— o^^vD^»-cri»-v^'— ^Ln^o^cocrirncrip^u-)o^^=}-(NC7\cr^ 
ovoor^iooococoocna^orN'— '~«-cofNr-o^^s|oaDr^^^^o^cNu^cO'— --3-r^ro(Noa3»— Ou^cDT-f^coaor^coco 


<T^  vo  cTi  on  r^i  u^  CT>  00  ^  ^D  o  o  1^  r^  rs]  o>  ^  f^  CO  o  Ln  *- r^  tn -O  r^j  ir>  oD  iri  r*  lo  ^  o  (N  f^  rsj  o  CO  cs)  r^  r^  uo 

r- <^  <N  CO  O  rs|  1/^  r^  vX)  ^  O  O  U^  CN  CT^  O  T- CO  vo  >  O  ^  U^  ro  ra- a^  ro  r^  rsj  r^  (N  rs)  CNJ  =t  03 »— CO  P^  ::t  ^o  rsi »— en 

oDcT'-u^o^r^iorsjooocno^.DOCNu^aDtnr^a^coLn'— 3'a3Ln^r^invoorvjro^cNu^^:3-cr^o.)or3-o^'~o 
■:Tvoa>r^^oo^r^^^lr^oovoco^o^n^oOM^voo^>xl^r^cn^^cNvo^o(Na^r^co^^u^Lnr~«>x>^r~»r^^c^(^ 

en  ^^  p>»  en  o^  CO  o^  03  cr\ 'vO  o  o  r*' CO  en  OD  CO  00  en  o^  CO  CO  en  no  OD  r^  a^  en  MD  CO  a>  OD  00  CT>  CO  en  CO  o^  o^  o^  CO  00  ro  o^  r^  en  OT 
oooooooooor- r-oooooooooooooooooooooooooooooooe^oooo 


o^^^a>ooooaooocnoo^crr-cncoc>covoo(Nr-oo*-niooroocr>oo'-'OorMLn("OfNO(Ncounr*in 
o>J3ocooooocnoocNooco'— r-\j3oo(Nu^or»r^»x)ooor^ocnor^ooooo^cn^o^oPOcncor^m 
o^cNOocNtnocNcnor^ooT— vrir- in.*  Or-rrouD  en  u;>o'^^ors)vr)  r^  coo  >.i3  CO  no  r-»  en  =tcn^r-v£)  cjpor^  CO 

^^lor-^^^r>■a^^oococJ^T-^o^'-or^^ooo^ou^l^^^ooa^o:3■l/^▼-cou3a^o^^(NO^cna^vc^>^r^r-•'— r-'cn^ 
CO'— ^c^vo:*c■lC^)^o(N^o'NcN3■of^cot^<^cN(N(7^oor^r^oo<^^^'^^>iCO(Ncor^u^p^r^LOcocDcT^£)co»-cot— 
ooa^<Nl-*l/1(NCN^cNCN•^co^^^f^^a3Ul::Ju^cN<^^vocn'— cNr^r-a3rsiT-rooc3Lnrov^cocnr^nounr^cNC')Ln^n-) 

\0  rO  iDr-T-      r-  (NCslT-  r-  ro      '-'-'— COCN      zf  \S)  (N 


oooooooooooooooooooooooooooooooooooooooootnoooooo 

OOO0000OO00  0C5  0OOOO0O0  00000O0O000O0  00O0000CnOO0  000 

ooooooooooooooooo^-ooooooooooor^oo'-oooooooocooooooo 

ococ^vou^r-cN^^^cru^o»-cNOcnocDo^Ln^sloo^ooT-ofnu^cooooo^rr^ooo(^^^JOcnol^)CJcncnOlr)^ 
r^r-\oooro'^T— '^a^<^oof^o^o^coLna^::3'(^rj'— ocou^(Nooco^cNt^'^^co=rr^cor^u^enir)^cnfor^cj-cn^ 

vot-  m  Ln»-*-     »-  fNro*-  T-     (N     »-     r-n"CN     cr        :a-fN        m 


»-fNro-^in»or>-a3a>o»-<Nro^LOvor^cocnoT-rsiro^iOvor^aocno'-r^iro:3-LO^r^a3eno'— e^ro^in'-or>-co 
cncJ^<TlCT^c^(cno^CT>cnoooooooooo'~»— '—T-T—*—r-T—»— T—f\jcNog  (Nevir^irsicN  CNCN  CO  rococo  po<o  rococo 


77 


CDzfOCDcomrn^o^^c^^^-^csi^  coincTir^T-rorncri  r-vovcr^r-mooo  ^aDuoLnromfNr~r-oco'— ^ 
^a^r^o:3•ocT^cNPoa^r^cofNLna^oo  >>ocnr-cocrtr--r>o  LnoocNcornoocNuo  ir)cr\o>:^rr,::tr^<Dr~r^(j^rnr- 
rsr»^r^ror^^O'~rsj'.Dr^'— oocT^LnocNO<N^ooo<^oa^cNo^'7^'-lr)T-coooooa^a^^o^(Nu^octctco.^ 


oo:3-crcx)a>Ln'^^cno(N:3-r-LncN3-     coLOCTico'— (^rocr*     «— >jd>oi^vduocoo     v£)r~-criir)roromr^'-oaD«-c3- 
ajvorNr^or^ocNT-a3rov^vDuir-(^o(^oo^crsTu^<7^oocNf"n^ii'ir^cxjujoosurvjropnr')ij-aDt-u^m 


cor*-o^r-crromocN(>i'— u^T-oy:?a^c^^^^u^oo:*r^o^(NcoroOLnu^r~•'^ocr«— r^poLOcou^vDu^r^ 
u^T-r^coo<^c^>cT^r^p^Lnf^r~>'~^•'~<NC7>M^rT^^o^^^r^o<^a^^s)aDor-:3•T-r-^r~~o»— OTu^cor^i^'—  o 

^  rsi  r» '^o  rsi  M3  in  CO  CT>  ^  3- CO  ^£)  \,o  CT>  (^  in  CTi  ^  u^  in  CT»  M3 1/1 C7^  1— rsi  en  o  vo  rsi  CT^  CTi  u^  r^  rs)  ^ 
oooor-^aD=r(NP^c^vDOLnr^chvoa^p^a^^r^cT^cDvoaDaDco^>r^a^r*coct(T^r^co(Nocoo'^fNLn'— r-o> 

Or-r-T-oOO'-»-OOr-oOOOOOOOOOOOOOoOOOOOOOOOT-T-or-T-»-»-T-r-o«-o 


CN^r^4«— ao^oO(Na3or^^t^ou^»-u^(NLno=rrsir-^rn»-r>-cOvOMDco^»-<N(Ti»— a3r\jvo'nr-»rs)coa>T-o^''0 

po  r~»  lo  »- -iD  IT)  f^  ct  o  >^  rn  M3  un  uD  1^  cr  r^  rs) «— ro  r»  (^  f^  cs  en  r^i  oD  r^  rs)  ro  MD  >  JD  tn  ro  p^  00  r^ 

^sJo^cN^u^^^o^crcto^c^l'0\iDrn(Ncrr^'— OPOun^x)(^oa^rsjoQornr-oaD^r~»ro.3-^co^c^ 

(No  (Ncsj  o  ^ '— CN  r^  :^  CO  CN  o  o^  r^  cT^  r^  (T>  00  T- (7>  a^  rsj  T- oo '^  00  (N  00  T- rn  T- r^  ro  oi  o  rsj  (N  o^  r*  03  a>  rn  CO 

cj^  o^  oi  fo  CO  cT^  r*  OA  cr»  cT»  r^  r-»  r^  CD  no  CO  r^  r^  CO  CO  r^  00  CO  CO  oD  CO  CO  00  CO  cTi  CJ^  CO  CO  a>  (^  cTi  C7>  en  CO  en  cT\  CT^  en  CO  o^ 

oooooooooooooooooooooooooooooooooooooooooooooooo 


^ovi)r*or>OLnorootNm<NaNoocoou)o^oooc3(-saocr>i^o^oor*or*r*»t^co(Nooop».cN^»-'— 
rnou^r^ooD^-uDocoop>~r^r^ooir)-=tor^o^ooororo^ovo<^o^r--or^O'or--POvo^ooot^rsiLnop-» 
>,oOfocoou^r--cjooonocorsicoco-=f  ocno^Ov)OLnror--oo<T\fNcocfoo^oa>rsivocncnooor«.coc3cnr^ 

■:*  u^  in  LO  o  CN  f^  CT^  rn  M3  en  a^  o  CNi  (7^  r*  crt  r~>  CO  o  evj  u^  en  T- in  o  CO  o «- o  a>  (N  u^  rvi  oD  :T  u^  ^  r^  a^  <X)  00  u^ 

CO  r-.  r- v£)  uo  ^3  CN  o  en  r^  CNj  r^  ij '  N  00  ^  rsj  cTi  CO  CN »— vo  U3  in  o  ^ »— vX)  T- CO  •=>■  cj- en  r*  en  r^i  ^  00  rsj  in  u^  t- r^i  r~»  (^  o  03  ^ 

(Nco:Jrna^oocN'X)■^•^or-^^OCN■3■a^^s^ln(Nr»CN■^(Noo■=roo^NCN^CT^<J^^ocJcou^oor~>o^o^N'~a^coooa■(N3•^o 

in^a-     r-         rooo*^  CN  t— (N  »-         r-  »— 


OOOOOOOOOOOOOOOOOOOOOOOOC^OOOOOOOOOOOOOOOfNICTiOOOOOO 

oooooQOOooooooooooooo^ooocioooooinoooinoooor^-r^oooocso 

OOO(NOOOOOOOOOO'X)OOOOinor^OO00OOOOoOC0O  00:3-0  0  0003  en  in  0M3  000 

T-o>x)rooor^oc5^or-»ooooocnr^ofNi'— ooooinosDt^r^oooooooa3inoo»-cncDi3T-«inro*^cn'— ^ 
r^incnr— 0<NCOOOromCNOOrN3'Oi^::rOOcOvO»— ^Ln^^(NC0CN'— coooocncNr«-vX)mr^r-:^r^:3-oror^ 
cNr^oro  ^ -^  ^co  ixi  en  r->j3r- en  a- in  rsir^f^r-rsi^a-njin^^cNoo  in  oo')oo(Noao  00  vtj  en  00  fNujr*u)rocNfN:3-ro 

in:*       ^  CNCN'sD^       ^-CNI       T-  r-  r-T-       CNOO  r- 


a\or-cNoo^u^'or~cocno^~fNoo^Ln^r^cocno'— CNi  00  r*  in  vo  r-»  CO  <7io»~CNi  00  ^tnvor^  CO  cTiO'—cNoo-tt  in  ^o 
00  :* -^J  "a* -^r  ::T  ^d"  ^  ^  ^^^  ^  uo  u^  un  uo  uo  tn  in  t^  Ln  in  vx)  vi3  ^  <xi  ^  >x>  vo  ^  vo  vD  r^  r^  r^  t^  r^  r^  r^ 


78 


mcoro     CO     lo    CPU— qocn     ocoooqo     r-og     LDCTij^cTi  :3-  r-        iDa^cTi  '^oo     Loa5a^o^ 

U^C0U^Or-oOO(NU^a0'~O'— r-T— LnOT-CriOLOr^r>ro»— OOOOOOrOOOOOf'OOOOOCT\POOCOcj'a>fN 

T-OLnoLnoLnocNOocoof^^~»~onocoono^-=ro'-ooooooo'— ooor^l^nooo^T-o:3■^^o'-^ 

COPO  CN  T-r-  CN  CNcS- 


=tcrr->0'—     rN     ma>^'—     vor-T-to     oco     corr— (Ncnjid  cr>     cn        a^oozr  r«cN     cr>crir-cri 

aicoir)OT-OT— ocNu^(^T-o>r-T-r-a^OT-c7^ou^f^r^f^T-inooocrtocooocoPoooooo>rno<-ucrcricN 
^-ounoinoLnocNO'— cDom'-T-mocDnor-^o'— o'— ooo»-ooooo(NPOooocr'— o.^poorsj 


(7Nrsjvoa3co^ror^^po^or-otnt^r^o^OLn<NT-r^ornoLna^ocri'-rsjro::3-\Ovoc'^orsioor^aD^r^a)orv) 
a^  o  CO  (X)  ^  ;3- CO  :a- lo  a^  LO  r>  r*- cTi  rsj  rvj  r*  r^  ^  r~«  ^ -a- u^  c7>  r^  o  o  r^  TO  CN  oD  r^  lo  r- rs)  00  oD  o -■*  tn  o  o  o  c^ 

OoCNr^U^UDOctr~»t^U^r-r\JCf  ^vj^ro corn 0»-CN^(N UDt^  coupon  CTiCN 00 CT^:d•P0^OP--  :*'— rMOoncNr~-cr  x>o 

oj  cn  CT>  in  ro  ^  cr*  sr  u^  ^  ^  ro  ^  a^  lo  IT)  \^  vi3  >^  r^ »— a>  ^  r^)  CO  ^  cr  *- rT^  CO  v^  ^  CN  r^  r^  rs)  T— (N  cj  vo  ^ 

r- v^  vD  O  O  OD  r^  CT^  r~  OD  OT  OD  C^  (N  (N  OvJ  <>J  in  CTi  CD  CN  Cs|  CN  VU3  O^  oo  O  ro  PO  00  a>  (N  CO 'X>  cn  CC  CTi  a^  ^ 

000»— OO'"'— 0O0O^~»~'~»-T~»~O0^~T— *-«— Or-T-OT-OOr-T-OOOOO'— T— r-000'~000 


aDO(Nuo(N«— OPO'— of^rvjr^rn.ovocNonor^crT-t^oooi^octPooococriu^rofN:t=tcoPOoncooocop~>cN 
r^lr-aDr^^r>-oa^*-or^cT^cor>.f^ror^oaDrrcoo^ooooocNocNooo^op>>v^(Nrop^=t^lnr^lcrooT-o 
u^f^r»oa3  0o^oo^r-c:tPOiria^<NocNin^:3-CT>oooMDC7^roa3aoocr»rooc^Lor~-<Ntn^Ln(N'J3  0'— cNr>- 
r^r^cNPO^a3or^roo^a>cr-3-^v£)oor«-cor'0=i-ooocr>r^'— o^ocNPOcTicNr^^cof^tor-'cri^oo^u-i 
r~>ooaocr>ooLnocricoococococococor^ocrioocricoo^ooo  ^3-cnvj3cnocT>r^Lr)cocor^p>»r-»criaDr^criop»<cricn 

O000OOt-OO»-0O00000»-O0000'— r- t-oOOOO'-OOOOOOOOOOOO'— OOO 


<x>o(N>£>cNr^aDa>Lnpnrovcioooooinint^oovoinporr)oor*-oooo*£i^ooo^oooo"ifN04io^o 
coo<N^ror^inr^r^inor^oPor-^-oir)ocoostcTior-r*oocrioooin'vO>^c5oo^o:3-OLOvc)ocri'— o 

«— ^  vo  O  T- r^  (^  r^  O^  t~  r-- a>  :d- PO '- »~  1^  00  PO  sO  CTi  CO  CN  (N  P-.  r^  cn  O  Ct  0~)  O  ^  rn  cn  r— r~~  CT^  (N  CO  O  OD  O  :::t  C^ 
nir-fNCNr->r^r^^U^»-COr^vO^CNCN(Nr^Or~»CnCri^:JOOr-::jrnt^^POO^cS-POO'— ^O^Or-iriPOCNr^-OCNCN 

^rMa>^-coPOcncor~-r-»— <7»aM^r»r~^'^co»-p^cri^Lnr-r^po     cocNrnr^-^r-o'-^^'^Lncor^iri^r^ooo^ 

INO-crarn  OCN  CNT-ir)lN(N(N  nro  fN«-T-       r-:3'oo  CO  T-tr\T-(N4 


OOOOOOOOOOOOOOOOPOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOLnOOOOO(NJOOOOOOOC3  000000fNOOOOOOOOOOcr>000  0  0 

ooomovoovDininMsco^^^crr-ooooocNcroornLnvoooMDcncNooooooooo'-c^jooo 

o»— »— cntr>PoorncncDcor^op-"r^r^r~r^oocorsir^pornvorocr»uococNvoaDrN|N>or^cnoLOCNu3CN»x)^ooT— (^ 
T-^r-coo:a-r~^aMnLnT-u~)tnir)LOoo:3-Lno>rnropo(Nt^m    v^^cN^rnr^cNCDcnrrjLn^d-POvCionr^oMnr^po 

Ovor^PO^  POCN'—  CN*~vors|<— (N  POCN  CN'"  T— 3-U1  tr>T-  cJCNf^ 

CN  »-  r- 


r^oocnor-rsjrocru^^r^oDcno^-T— cNPn^ii^vor~~aDcno'~(NPO^LnvDr^oocnoT-rsiPO^Ln'sDr^cocAO'— CNPO 
cocococno^cncncricncricncncT^oooooooooooT— T— r— T— T—r-T— T— T— «— cNCNCNCNrs)fNrs)rsif\i(NPOPOPOPO 

r-T-T-T-T-T-r-t-t-^T-T-T-CNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNfNCNCNfNCNCNCNCNCNCNCN 


79 


rsi'-o^or^orsirsiT— cNOu^oao^^LO^»-oonoor»cNoror^coooonoM3rnrnroo^OLnocnooLnoLO 

r-om::*OLO^-r»~roo^orroLr»oono^-aooor-o^=r(Nooo^oor^ro^cooo>x>oir)Oo  oo=r 
og  rnc^zt  ^-  rn     r-r-r-     m  CN  cn     CN     rsiro 


rNjp>unrn     mrn^tG     cr\     rNr~»(Nr-r-T-     ror^     »— cn     LDr-cnoo        cn     coLnLor->cNc33     »-     r-         cn     cri 

^rnCiCD       (Dr-CNCD       '—       vOr^CNcST-CN       CNt-       LTlOD        r-O^r^  C7^       (N:^-^  Cf  OlO       ID       r>»  ro       00 

rnc^r-c^    LnoT— vD     <o     coMDCNMSrocTi    p-»r-     v^iT)     »— c7\-=rr^        LP)     QOo^ror^cT^on     no        o     co 
cNa^voc7^ofSCDT-^^|Olnoco^^<Ol^::J•'-oonor^cNon^*■oou^oof^o  -onc^novoOLnoo^ooLTiOLn 

r^onoo'J^or-rnovoozrcocnoono'— cx)oo«— o*— ■a-cN'~oo^oor^'^>.£)cuoo\i3oir)oo^o^ 

IN         f^CN^     r-     (N   r-1— r-   n  CN      I      fN   CN   CNCn 

I 

or>•cDU^cT>r^u^r-ncor»ocDOoo^o'— '^coT-v^^f>oa^cNo^no(Nr~r-cncricr>o^u^oo<x}ir)r^r^v£)u^ 

n  CO  (Ti  r^  CN  CN  rs)  n  U^  CN  :3- C7^  cn  n  lH  (N  O  <^  IJ^  O  cj  n  O  CO  cr>  03  U^  CN  LO  «— v£)  C^  3- CX)  (N  tn  o  n  r^  CN  rn »- ^ 

r^  v^  r^  1^  ^  >^  n  CN  CN  o  vi)  r- r— lo  T- CN  lo  t^  >£i  c^  CTi  r^  u^  CN  CN  r>- r- lo  ^  i/i  f^  o  CN  cT '"  lo  \o  CN  n  <n  r- <Ti  n -^t  =r  CO »— ^ 
cNO'X)fNocrivo(N'— na^aD^u^o>^on^ococT^r^^^^r->c^cx5r~*r^^^»-cTlU^cDt^noo<3^c?^or^^^J(x>cJ^L^ 
;:?  tr- rg  uo  o  r*- rn  ^o  CO  n  ^  ^  *X)  o  CN  r^  r^  o  u^  r^  r~  cTi  CX5  cr  C7^  u3  CX3  ^  00  r^  c7^  CT^  v£)  r~»  cTi  lo  Ln  o  CN  r^  t^ 

o»-oo»-ooooOooo*~'— oooooooo'-oooooooooooooo'— oooor-or-O'- 


LO^oocNLO'^cNsO^-OLnMDnou^o^^-i^oa^Lor^r^T-cN^cTNrvjT-voLnroo-OLnp-'T-LOcoctOLOLntjr-^c^  -^CN 
ocNajaDvocTir^rtvor^r^i-OcN^-a^nin^coa^rsi^cTir^cr^OT-vo'— CO'— nr^cNO*— o»-co»~c3"r~»0'oco'^ 
^a- =r  cn  o  :^  lo  cr  o^  o  r*»  (7^  o  cT^  o^  ^a- oD  rs)  LO »- ^o  CN »"  u^  »- C7^  r- cnj  o  o  r^  o  r^  CTi  n  in '— ^o  u^  CO  cTi  u^  o  CN  CN  n  p^ 
o^or»«a^u^cocN^cNrr^r^r-aDcNcor^cN'— =tcocoT-c7^a^lr)^^lr)vx)OaDOLncT>cocNr-=^a^a^a^'OCNcN^l^u^ 
CO  cT>  CO  ^  r^  r^  ^  cT\  r^  rj  zr  r^  r^  o  r*- CO  00  r^  oD  cx)  p^  r^  o^  o^  CJ^  >vO  r^  CO  f^  r^  cr\  r*- CO  CO  00  CO  r^  oD  00  P-- u^  ^o  cr>  r^ 

ooooooooooooor- oooooooooooooooooooooooooooooooooo 


coor-oocno^'— roornocroooooco3-LnincNoo^or«cNOooLnoooc7(00oaoncTinooooo 

^ovooininoor^nco:3'<oco'-cNCN<33cocoo-=rooQOocNC)r^ooir)Ooinrofnroor~-cocTvLnooooo 
cooc-or--u^=tocsu^u^aDaDOoncri-^r^r^r^cf^co>^(nu^ncriciDouncNcocoLncfnvOOu^ctcnr-oocr>^ 

r~»iO(-sjcoa3u^LncNCNCN(oo^ooor^c7>r-cna3(7^t^ncN^o^r^'~^o^cnrNinr»voncNcNLncN^a^csjio 

»— (NoniDT— ldolt)     cn'— »-ocoocov£>fN^r~'— or~-cTio^fNor^r-<yiLninp««cx>r^*~«™cr>r*cN:^T-(NcocTiLr)0 

▼-^^r-^^J       ^-CNLT)  ^r-       C^COCTi      r-       (')v£>CN  CN^  CN       <0       CN*—  ▼— (')       «—      f* 

CN 


ooooooooooooooooooooooooooooocdoooooooooooooooooo 
ooooooooor>.ooo^ooooo<r^onooooooooooooooooooooooooooo 
coooonooor^^X)'— r-ocoLnooocoo'Oooo.:3-ooooino:3-r»orsjooooLO:3-cNOocoofNo 

Lnu^cNOcx)u^cNr^;rp»oo^c3o=Tn^ooaooa^Lnoocn^>•^r-c7^nu^u^^~•r^a^aDoc^rT^cNT-^— councnncNP^ 
r*>ir)C0LnLn::3-oo>x)     crcNctcn^^OT-^u^cncT>^^o^oo<ou^c^^cn^cN<^Ln^^^cop^cNu*)voc^^crc^>^(X)t^l(X)tn»— 
(NvijforN     r-r»co  vo         =rcN^     r-     n>^«~     T-     cNui     T-        n     «"     n^~  »— cn     t-     vc 

^lr)vol^ooo^or-cNro^u^>^r^coc^or-cNnctu^vop^a^cno^— cNn^u^vor^oDcriOr-cNrncrLn'sOr^oocriOr- 
rnco(nnnc>o^::*::f  ^cr:3"cr  ::f  3-^u^ininu^LnLOLOu^u^u^u3UDM3'0^\^vo^>^u3t^r~»r^r^r*t^ 

(NfNCNICNCNCNCNfNCNCNCNrNCNCNCNrslCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCNCSCNCNCNCNCNCNCNrjCNCNCNCNCNCN 


80 


o-:*     cocnr^o-)T-cricno::tcj-cNCNc\i     mo 
coinocj-cTicococoir)v^^f^r^(NoocNO'-o 

CO  on  o »— o  r^  r*>  rn  T- fN  o  fvj  u")  r*- rn  fN  o  cN  LO 


t7^ 

-C+J 

>  u 

WO 


CT^O^roa^(Nqc7^LnO^^— CO  OCTiOOlOO^       CO^CT^ 

v£)'— cNcomrsjrsjLDroLDa^T-cricj-vocri  crtN<^ 
ootn»-r~>>x)Od-toocouD»-co^'-rN  orsir*~ 
'^LninT— ^OT-or^o>xiLn'-o=j-=tinocNP-LO 

(^        CM       rs|       rslT-r-  r-  r- 


r-ro  c7^=t•v£)^or•a^(N■^r*o^^-mco  Loro 
=tu')  oM^vocnT-r^voinmcricouDo  r»r- 
o^  coCTir^rot-o^cTiOrsi^fNr^CN  n-)o 
oomo^cT>ooGoooinvi)v^cor-(Moo(NOr-o 


oorno'-or~»r»rn< 


■CNOOLDr-rncNOCNuO 


+J<T3 
O  M 


CTi  no  ro  cTi  CN  O  lD  CTi  r- CO  O  Cn  o  ^  CO  CTi  U~)  OD  =t  r- 
>^  T- fN  CO  m  r»  CN  Ln  rr)  IT)  T- »- CT>  ■=!•  CO  CO  (N  3- fN  r- 

oolO'— r^'^oocri-nococn'— covo^o=roo-iro 
vx>  IT)  LD '— cr  o>  T- o  r^  C3  o  u~)  ^  :d- CN  r»  in  CN  r^  lo 


cNvoviJCNCN'Xx^^a-'OunornMsro' 

n       CN       CN       CN'-'-  T- 


■(NCvior^ 


r*»  :^  vo  (N  o  =r  c3^  <Ti  LD  a- T- LO  m  r»  en  o  ^  cr  <N 
CO  T- f^  ^  lO  in  to  \o  r-~  00  cr>  v£i  CN  CN  LD  o '— ^  r^ 
ro'— cNr^cNu^-^cNf^cNcoo^cN^r-oc^on 
cocNLnT-m^ofNjcN»-OT-cr\r»ooir)CNin^ 
CO  (^  en  o  o  >xi  o^  iT)  1^  p> «— LO  r^  in  CO  r*»  (^  ^  o^ 

O'— Or-r-O'^OOO'-OOOOOO^— O 


m 

CM 

o 


T3 
•H  U 

cQ  a, 


>X)  r- CO  ^ 'X)  CN  lo  cr  3- CN  r- cTv  v£)  ro  vc  ^  in  ^J"  zr  ^ 
T-cT>cn^^v£)roc^^co^roLncri^LnincNmo 
inco  ;r  en  CO  ^opo  (Nr^  ■X)ooaD '— oooin  ui  o  ^ 

iniOcnmOr-C3>CN-=JTOroOOcDOOf^(NO'sOU^ 
T-'-'-  T-CN  CNCN 


^ocNn-)r^  r^-r^a-cNoornT-cj-ocnooco  i5 
in  vo  o  CN  r\j  o  o  r-»  o  o  o  :*  rsj  (N  vo  tN  t^  >X)  -O 
u^  in  CN  rsj  a^  o  ^  r*  <— en  o  *— r^  :3- r^  3- :^  CO  CN 
Of^iOino'— T-cpico^-oo:*cocNO'— men 
r^  en  CO  :3- en  r>»  ^o  r^  r*  ^  o  CO  r»  ^  CO  OD  r~  lo  p*- 

OOOOOOOOOOr-OOOOOOOO 


Q 


>  C 

+j  a 
c/^m 

O-H 


oooooooooooooooooooo 

OOOOOOOOOOOOOOOOOOOO 

cT>  CO  in  r^  en  uo  rn  ro  :3- en  o  cj  CM  CN  r^  CN  en  c^  c7> '  T 

CO  00  CO  in  CN  O  cr  r^  U")  ro  MD  ::*■  <sD  (N  fO  ^  r>  CN  es4  ^ 

T-LOcrv^vx)mcnr^PorNco^ocooo«— m^o 


op*aooT-ooo^O'^\oornoooooo 
oooocNin^^-T-inop-vooooooocN 

CN  00  CO  00  vo  o  cr  o~>  p^  T- in  en  o -^S"  CT»  o  vo  ^o  ^ 

<NCNLneNirocoT-r^r>OGO'-^eovc:3-Lnr^co 
cocnoooon  (TicocNcr  cNcnr^roin;3-(Nr\|v£)\o 
r-     vij^        in     in     ■3'vo^"'— 

C^ 


:* 
o 

•H 

C 
CN 


CO  o  CO  CN  00  (N  r«- ro  o  o »— lO  in  :^  (N  <N  CN  cn  CO  r^ 

r^oinr^r^or^^'^cNr^onc^'— r^orocn'— mo 
:*p^in(^r^oin^mcocn^cNnT-co-:3-cncnoo 

r>»  o  oo  LO «— n  VX3  kj3  r- >^  CO  rr- lo  en  en  en  en  C7>  rn 
^  sO  c^  c  N »— r»  vf  »- =T  00  •:3' in  r*  en  T- in  r^  ro  in  r^ 

r-CNcT  invO  :3-rT-rnir>vCvUCNfN(' »rnCNf>0O'»r^ 
%    «  H  %    s  % 

vOf^      M3      cr*-  (N 


ooooooooooooooooooo 

00000O00000C5000OO00 
OOr-OOOnOCnOT-OOOC7^0:3-vOLn 

C^i^O'—O  00  CNOU3  OCOOr- ror- CN  in  V£)CN 

en  crcnr»<N -a- ^»-i,o  ^oocncNOooc^n  ^r* 
T-  in 


-P  =ro^jDcoincNjcNC3'-couDco3-r>-ooinooc3rnr> 

U  M  ■=r  CO  r^r~o^cN  in  r^*X)  en  CM  r~>  in  r^  mm  r^rt:^- 

(T3  (U  rot— CN'-m'— CNr-Cn^CNcn^^^^r-mcNLO 

Mja  r*'r^cNr*'^r*fNr>rsi\^r^r~-cNCNfNorNcNov£» 

-PS  t    I    I    I    t    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I 

G  a  '0^r->x)Ln\-or-^r^m<x)i^or~r^r-oor~r^aQm 

CJ 


cNm:^mvor^cDcnoT-cNfn^mu3r^cocno 
00  00  CO  CO  00  CO  CO  00  en  en  en  en  en  en  en  en  en  en  o 

CN  CN  CN  CN  CN  CN  CN  CN  CN  CN  CN  CN  CN  CN  (N  CN  CN  CN  ro 


:»r-cNf^^m^r^oocno'— fNimc^-mMor^oocno 

O  r-T-^f-T-T-r-T-T-r-CN 


81 


::*  03030-^  en  rocj-r^r-     CN^— rM»— ^oco»-fN(NrocNu~)(N(NLOCN^oor*o>cor*»     ^o*— '^o^Lnt^oocr^or-- 
o  ^- o  r^  rsj  MD  r^  r^  cTi  o  o  rn  CN  rsj  o  o  ::r  (^ »- (N  CO  =»■  r^  oD  :*  CTi  u^  o^ »- ;:*  po  ro  r^  o  o  en  rs)  r- (X)  a?  c^  o  r^ 
T— rr)v^^:^T-^r>iu3unocnp->r^or^cov£)roo^^Lno(Ncoin::trs|inr-^iriO(NO'^or-rvja^r^rsiT-cr^ 


^or»cr>^roroco^»-     inmcNT-cnoo^f^cNO'— Ln^o^u'irsjuaocrvinsOr*     ::ro*~rr|o^cNoaocr^or*- 
oa^rosOfNor^^unooT-ocNOv©::*'— r-^^aJ<^looaDa^(J^Lnc^l^^^^JO'— oocn(N»-coa3cr\T-(^r^r^r^ 
T-rsj^vo^r-T— r\l'^OLnoo^vot^o^^covo(^co^Ln^^cNCNLn^^^4LO»-^^^r-^^JO'— OT-rscr\r^'-'— (^ 

«—  T-CNr-T—  r-  r*"  COCN'— 


lo  o  (^  o>  a\  un  r^  vx)  o  ch  o  rs  a^  rn  r~~  cr  CO  >x>  (^  o  Ln  cr»  00  p^  OD  CO  ro  3- CO  r^  ::r  r^  ro  (N  T- '^c  ^d- CN  r  J  r~- o  L^ 
o  :3- r^  rsi  f^  T- r^  o  f^  CO  CO  en  o  o^  r^  rn »— CO  t^  oD  ct  ^  t^  en  >-o  03  lO  n^  oD  IT)  o »— '^  in  en  rs)  rn  lo  CD  r^  en  T- f^ 
:*<N'^cNcoor^Lnocnvo<^T-«— cor-rou^coor^or^»-rnp-«\oao'— ou^ocoocrf^a3r-r^(Nr^cnr^o^~r^uncn 

u^r^*— ^-rsiuiLOincnpocnctovo'— vo^otn(Nr-vx)0^oounooo<Nu^niu^cNrnu^o\,orsjr-crcT^=roroo'~o 

T—     fsj  T—  T—     T—  ^  T— T— cN  Ln»~ 


oooooooooooooooooooooooooooooooooooooooooooooooo 
oooooooooooooooooooooooooooooooooooooooooooooooo 
Lncn^^a^u^::Jn^r^^Lnor^cr(N^o^rsJCNo^oooo^^^ovo■^■oou^<-r^<^a^o^»-voc3^oa^^nr^:3•^>»LOl^ 
p^  r*i  CD  in  rn  CO  T-o  f^orsi  CO  a>  op~- ^  ^  olo^olo  <^  en  en  r~  CO  voog  CO  030  3- -0'—^'—voo^  ^r^o^x^vo  <orsjf^Ln=r 
CN  o  rsj  r^  rsj  :3- cj  o  T- u^  r- (T)  CD  r^  en  T- rri  v£)  eg «— en  r^  r^  o  a>  rs)  o  o^  CO  CO  o  r^  .-:f  03  o  T- en  1^  ^  CN  rs  ^  ^  o  00  en  pT)  ^ 


•  o  o  o '— T- '— »— T— rs|  o »— »~ »" »" «" '^ »"  o  o  T— ^- 


in  rn  CD  r«- en  (^  CO  r^  :* «— r*»  o^  ^  v£)  o  vo  no  rn  ro  t- 03  <^  ^  r^  ::t  vD  ::r  cr  cj  03  CT^  ^  en  r^  cf »- f^  it  ro  u^  f^  1- ^  en  ^  p^ 

t^  r^  ::*  n^  rsi  u~i  u3  vo  r- o  r^  en  r- ^  03  c^^  en  rn »- a>  o  CO  CN  u^  CO  po »— a^  o  en  LO  o  CO  o  r*>  vx) »— Ln  iT)  (N  u^  cr  in  rsi  (3  r\)  T^ 
cnPO(J^o^vx)co(NcnT-oa3030crLOOT-vcena^cna^or^vO'^oooa^vO'— ooiO'soaoOT-*— (NT-ooooLOcj-rn 

fN^a3a^r^^^r^cnLnf^lncovo^LOOf^^^a^^f^Lnr^r^a3T-a3^3■^o^^~<^u^'vOoor^-:^■crlPoocor*OL^ 
u^cn^McTo^r^T-c^Lncnr-Ln^N^svooc^u)(^^^^<JUooco:3■cn'— cocnr*-(^^o^•^■^cooo^^a3^N(^^cQ^^l^^::5•^^vo 
f^'~^/1a^T-^^^N^*■e^r^f')^•r*^'>^co^cN^ouJao^^^~•^r^'~^^ul^^tNr^^')r-cD(^lr)Loaoov£)fN^~^~^^|T-^ofT^cJ 


CT\  ir- ro  en  p~.  03  cf  ro  o  C3^  (^  r^  lo  en  :j  rsi  cvi  i/^  ■:*  o  CTN  r- ^  o  a>  ro  o^  o  lo  03  r- ^  vo  r^  en  p^  p^  \r)  r- en  in  C3  en  en '— in  CO  ^ 
fn  ro  r~»  en  u^  (^  CO  po  in  >^  o^  o  r^  r^  o  ■:3- in «— vo  r^  CD  IT)  r^  03  o  *^  (^  rs)  en  en  u^  ^  en  ^  :d- 03  03  r^  rn  03  ^o  \£)  r-- en  vi3  vo 
LncrocNo^(Nuir^(NOui=rzr(Nr-o^rnr-T-o30T— cocj>infNuna3^J3rsiLncncNr-r^fNu-)»— cjcNT-^oo'— in'— 
orNrsjr-<NOocNrsjr<joo^oor^r^(^'^CNrsir^j(N(NorNCNinfNooinorsiinincNinor«oor^M3incNininfN 

I   I   I    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    t   I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I 

03  r^  r^  >J3  r^  o)  CO  r^  r~  r^  CO  00  in  CO  ^  ^ -a- in  r^  r^  f^  r*- r- CO  r^  r~  en  r- 03  oj  en  o3  r~~  o^  en  r^  en  CO  v^  oj  03  VX3  in  en  r~- c^ 
r^  r~  r^  r- r^  r>  f^  r^  r^  r- r^  r-»  r^  r^  r^  r>  r^  r»  r^  r^  r-- r^  r^  r^  r^  (^  r^  r^  r^  r^  r-»  r^  r^  r^  r-»  f^  r»  r^  p^  r-«  r-- ^ 


»-(N<^^lOvD^^a^cT^O'— <Nf^=^^J^<^^^o^cT^or-^^^^^:^lnvor^a30^o»-<NmiJu^v^p>•a3cnor-r^J^o^rln^^r~•oo 


82 


pou^vO'-or>j»— rnvo^'^'~r^or^ocrij:^3-Lno>oo(NPO^inoocnooor\iroroPOT— o^t— oi^olocnodt- 


(Nr-Lncrirsjror»aDrsj<Ncr\co     ^i3  0^'— Lncrir^r^-o     inpocNooor-Ln     LDOocs-f^or^'^coro^cocru— lD 
CN^^^^(^^^l'^'-coa^^o^^^o(N(^oo^^ocn(NOvI^o^»-ln^cra^ocDr^:JzrcN^a^u^aJu^O'— (N<i— u-1^ 


0^  no  r^  vx)  (X3  (^  rn  en  rn  o  •»o  no  T- j^' en «— (X)  in  rsi  cr>  U3  o^  ^  ^  p»- tn  (N  lo  iT)  (X)  u^  ^  CN  T- en  ^ 

CO  r^  o  (^  ^  o  rs)  ro  oD  cs)  r- ct  MD  cTi  uD  ^  en »— ri- ro  ^  (^  o  en  rn  r^  o  tn  (N  »- \i3  CTi  cTi «— ^  (XI  f^  r*- r^  u^  CN  (^ 

(N  r- »- UO  ::^  O  UO  r«  r^  O  Csl  O  r^  »— ^  O '- T- ^  O  lO  zl- O  \0 '"  »— CN  «- CN  r^  no  (NJ  vX)  no  T— :*  cr  vO  r- r>- rsl  r- n «"  no  (Nl  r- O 

CNjfN  r^  »—  T—  T-         uo»— <N 


OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOoOOOOO 

oooooooooooooooooooooooooooooooooooooooooooooooo 
u^^^ocnoco^vx>nocnr-^>.u^a^:3•^t-T-r^a^Ln^^rNenr^^^Jnoaoa^(Noo^cn::tr»aDoo^no^^^u^«-uD^*^ 
j3nonor^^<-crrrinorsirtuoa3nnr^aDor^j;i-cnLnoio::*nsjnovx>a>uouoocnno^rgoocono^c3'— r^u3ri-nor-'r~- 
:^  o  o  r^t  ^  r*  un  LO  rt  u^  ^  3"  r^  U3  cx)  vo  f^  03  no  T- T- no  r- o  r- no  r^  (>4  o  ^o '— o^  ::t  ;j  rs|  o  rsj  cN  cN  oD  r- in  no  a>  r*»  *— c\i  o 

»-«-t— »— r-0»-'-'-T-r-T-»-T-^— OT-OT-r-f-r-OT-T-r-o'-'-'— ^Or-r-T-r-T-»-r-T-r-»— T-OOr-r-T- 


nOr-^OcrUOT— O^^U^<X>noOaD^^JCNOennO(X)vOCnCNu^^C^r^T-vDct>X)f^^Ooa^^^^COO^no^vDOLnlr)ODOCTl 

o  <— en  r^  r^  a>  r^  r- r^  o^  o  en  o  no  cT>  nsj  00  oD  en  r^  CO  r- C3  CO  r^  nsj  v^  f>.  IT)  cj  rs]  cr  Ln  ^o  T- r~  lio '^  00  cs)  ct  CO  r^  no  p^  o  no  o 
aDors^ou^T-a^u^o^^ctcT>cnoa^^vOLnooco^oococoo^oooocx)co(Nc7>cocna^^^r-onor»Lnoocnr^a^ 

^no=ro<»-a-rsjuor-\oa^*-u3<x>rscjv^oor^jc^aDcnoov£)cooo<Nr~-Ovot^^ono^(Ncna^or-T-uor^or^vorn 
o-:r<Ncrir^a^^^CT><Ncj-ui^tNocNr-r^coLncNr*»'— r"— cnMDr-ror^noajor^^^^tr)CNno(NencooT-<')r-fN 
0^vO3-«— r~;3'cnujvi3iN^y><Nr»oor^;N^(NnocrnopgtNcTO'icn»-cnvonor>-r-rors*J-'U)(N:3-ui=Tnr)     v^jo         «— 

to      ^roro  CN  T-CN  T—  r-  T— 


rt  lio  T- en  t— <Ni  <^  r^  ro «— p*«  o  cTi  no  C7^  03  r\i  o^  (X)  uo  no  rvj  in »— ^.D »- ^- r^  ^  <3  Q  CN  r^  =f  no  r^  no  n\i  en  no  o  o  rsj  vo  r«- 03  (X) 
T-rNinr-o3r-nvirv)r-^voono^^»-a3cnfNjo3^ooi^o»— r^cneno^r^o^oDr^Lnt— (Nr^noaor^asLOOvijnovoojcnvo 
noii^ir^^o-^ou:)vD<— T-M3ajr^r^uo^vi3novX3in^uo^DCNcru^CN^>>o-3-o-3-not^"»rsonoc^nN|T-ono<^f^Tno"ict^ 
pN.(Nln^^Jcnocna^c^cncDc^>a^ocnlnco(J^cr>o3cooo^ooLnLncooou^cN^u^oo(NnNuocncnL003^s^<JLnuo 

I    I    I    I    t    I    t    I    I    I    I    t    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I    I    I    I    I    I    I    I    I    I    I    I    t    I    I    I    I 

\X)r^tnr^cjooo<300»— ooouoenr-oo'— r-T— T—'— cno"i«— cN040^r^r>noo)cor~r^cnociO"i'— r^ajcno"io>en 

p^  r^  r^  r^  CO  r^  03  CO  CO  03  o3  CO  03  f^  CO  (^  CO  oD  03  oD  oD  03  CO  o3  r*- r^  03  oD  03  r^  r^  r^  r^  r>  f^  r^  r-- r~- CO  CO  r^  TO  r^  r^  r^  r^ 


CT>  o  ^- rsj  no  3- in  vo  r-»  CO  o^  o «— ns)  no  cr  to  vx)  r>»  CD  o>  o  T— nsj  no  ^  lo  uD  r^  CO  tr^  o  r- ns)  no  ^  uo  v£^  r^  CO  en  o '— nsj  no  ct  lO  vi) 
vor^r^r^r>r^r^r^r^r^p^coo3coo3cocoo303ooo3encTicTicncnc7^o>cnLncnoooooooooo'~<— »"'"'— »— ^- 


83 


of^i^T— ^^JOLnoa^^v)^o^»»-oomor^nop-.oomovD^^mmo<ooa^o<^ooLnooo:no^c^a3a^LnMDf~^ 
O'— r^r^movr)o^OLnoroOT-cooo»— ^oov£)oor^rnu3cooo^oi-ooov£)OaDPnoT-or^ror-cN(N 


con^T— ^     vo     cD'OCNrncTi     r^r-     sO'~cnr»     in     'X>o>rnr^(j\rn     ro     o         o     0:3*     cDcrir-«T-cricri<N 
OP^(Nr-rNOLnooor»vo■^■r-oomor^mr^lnop^ovomo^^no^ou^o<J^oolnoaDu^o■3•c^^cocDu■)^£)oo 

O'-I^r^r0O^Oc*C0LnOmOT-C0OO'r-=3-»-O^Oor~-m-i3Q0OO^OL0OO^0Oa0rr)O'-Or~n-)T--fNO 
fNCN^  «—  CN      T-T-      PO  fN  CN      CN      CNrO  t-  t-t- 


uncNr^'— 0'^cN^-o^p*•a^OT-r^coc^^cT>oo^^cNT-cNu^(^o^u^cnfnoa^(X>lnc7^f^oor^mlnr^lcna^cN«-oocD 
<Ti  cx)  r~  r~- «~  o  in  cr  tn  lo  T- cr  Ln  p*  ro  r^  CO  u^  vo  00  =t  r^j  r- u^  (>j  o  ro  cj  cTi  CO  o  o  vo  ^  (N  lo  in  (N  cT>  rs)  CN  o  =r »- ^ 
r^  r~>  o  r^  c7^ '"  :^  CN  ^o  r^ '^  >^  CN  vo  vo  ro  cT>  ^  in  CO  cN  \X3  o  o  ro  cri  OT  a^  CO  <N  rsi  =r  00  r~»  <7>  <N »— ^o  o  CO  cn  r^  ^T)  TO 

^'ro^ncNLnc^^cNcTla^TOr*•lnvco^c^^r*>p^oooo>4^c^J^»-cN^cNc3■cN^TO1-cNa^:3•cN^'-ov£)cr^:^•\oc^l^^oo 

CN^~fN   »— ^       CN   T-T—  r-T—   ro   t—       n       r-m   r-   r-   ::3-     t-   (N     CN 


000000000000000000000000000000000000000000000000 
00000 00 OOOOQ 00000 0000 0000 0000 000 00000 000000 00 000 

r-aDmr^cNinr*-TOr-a^»-'.ocN^<Nr»oinvocnrvjTO^-3'or^T-in^^in^cNr*'CTico-:3"a>r-^rvjJD<NinT-<NOin 
r*»cfrnrgrsiooo(N^r-poo'— ::*rNoin(^Jin^Lnr^^r~-vx>'— cocN:*p---^TOr~-'— rr)oooocj-i-NifNjor~0'— r-<Ln 

C7>  <N  f^  O  C7^  t^  vjO  CN  U^  T- ro  o  r^  ro  u^  T- ^  r-- U^  T— O  ro  CTi  ^  r*»  r^  CJ^  CN  cf  03  ro  rN  r*- O  m  03  f^  r- r^  O  O  T- r\)  Cs)  m  ct  ^ 
O*— t-CNO'—»—r-«—r-»— CsJ'—'—T-^'- Or- r-^i-Or-Or-OT-T- O'—'-f-r-T— o*- '-'"'— ^»—«~'~'~T-,—  T- 


»-oc7>r^inr^incr»cNr^r^cNrsi>^v^a>»— Mor^^rncovoo'— ror^(N>X)cNTOocn=toooor-cN::*ooinfNOTO^cN 
ooc^T-^or^voo^cNocT^o^cT^TOooc^o<TlOTO(Nlno^OTO^cNcr^c^-Lnr^(J^TOlnr^^^/cx)oaor~lnr'")TO^^^^^^^o 
oino'-<7>r^^fnoroLnLnocT«^cooTOo^ocTvnnro^oor^o^ocnvocNr^in'~ocri^r»o3-'-"(^'-inLn 

cn^oLn^o^^^aDCNr-crTOCOo^lnM^fnlnocNvolnf^»-'^cTlvovoc^cTlt^colnlna^^J^^rcoln^T-^or^lf^oa^r^ 
r»^3-T-vo     CN»— inr^CfNrs|T-(Ninco^cN^f^r^<Nui^a3coot— r\icri(^CNvu'^coTOCNin*-cTicr(^v£)CN>>o:3-a-vo 
T-in  ■:?■         O'—     »—    r^vor-     a-  CN     r»     CN»-  T-f^     CN     <— r-     cj-cT'— in     vun> 

r-r-  T-  m 


rn  r- »x)  r^  ro  rvj  (N  rN  CO  r^  cn  r- OD  cc  r*  r^  CO  ;*  rv4  <N  vo  :*  ro  T- r^  o  <X)  r-«  rv)  vs  o  r- *- rn  cf  in  a- in  CN  r- (N  TO  r- M3  if  cn  in  rn 

inTOTOct»-CNCN-^cnr-fNv0^inOOvO=J'"X)'^r^rorNCN»~''J3CNT-r-m-^CNC^'^0»~^CNin^^-3''— r-in^vO^-v^ 

o>incnTOorn'^T-fno'-crmr*^T— vx)ro^TOinr^vi)^>^TOf^or^rsi'— f^^^r^-^r^coTOr- ovooctroisDojf^ 

ininmTO0TOTO0TOCrvOTOTOTOCT>CriCP>roOTOC5  0C30TOTOTO00000TOOTOOTO0TOTOOTO0  0TOOroO 

I  I  I  I  I  I  I  I   t  I  I  I  I  I  t  I  I  I   I  I  I  I  I  I  t  I  I  I  I  I  t  t  I  t  I  I  I  I   I  t  I  I  I  I  I  I  I  I 

O^Cno>»— CN»— '— rN»-0<NT-T-T— 000»-CNT—T-c\J(NCNt— r-»-CNCNCNCNCN'~CN»~CNT~CNT-r-rs|T-rM04r-(NT-lN 

r^r^r^TOTOTOTOTOTOTOTOTOTOTOTOTOTOCOCOTOTOTOTOTOTOOOTOTOTOTOTOOTTOTOTOCOTOOOTOTOTOTOTOTOroTOCOCO 


r^TOcrlO»~cN^n^ln^^^^TOC7^0'— cNf0^in*X)r^TOcno»— cNroc*invor^TOcno«— CNro^in^Dr-'TOcno'— (Non-=t 
»— T-T-cNCN  CNCNCN^NCN  cNCNCNcn  00  r^rnro  c^mf^  encode*  ^:d-^^^ci- cr^  in  u^un  in  in  untnu^  in  in  vO'^ovO 


84 


ooooorsjvij 
t   t   •   •    • 

r>roLno^ 


ooooo 
ooooo 


r~(X)oocr> 
«  »  «  h  k 


or-or^o 

ooooco 
I    I   I    I    I 

(NCNCNfNr- 
CO  CO  CO  CD  CO 


mvor~cocn 


85 


IIST    OF    EIFEEENCES 


1.  Hanrahan,  J.  D.,  Government  h^  Contract,  W.  W.  Norton 
and   Company,     1S83. 

2.  U.  S.  Department  of  Transportation  Report  AD-DT-3-002, 
President's  Council  on  Intearit^  and  efficiency  Audit 
cf  Const  ruction     ^onjEracT~Cnan£e    OrHers,         T7    NovemTer 

3.  Yuspeh,  L.  "A  Case  for  Increasing  the  Use  of 
Competitive  Procurement  in  the  DOD,''  Bidding  and 
Aucticninq  for  Procurement  and  Allocation,  pp. 
1UTFT2F7    New~Tcrk   UnlversiIfPress,     T^To": 

4.  Weiss,  W.  H. ,  "The  Fallacy  of  Competitive  Bidding," 
Government   Executive,     v.    8,    pp.    38-39,    February    1975. 

5.  lytle,  W.,  "The  Fallacy  of  NOT  Bidding  Competitively," 
Government   Executive,     v.    8,    pp.    4  0-41,    February    1S75. 

6.  Nash^  R.  C,  Government  Contract  Changes,  Federal 
Publications,     1973. 

7.  Gaskins,  J.  K.  ,  "Changed  Conditions  and 
Misrepresentation  Under  Government  Contracts,"  Changes 
an^  Changed  Conditions:  Government  ConTracTs 
"HonograpE  No.  3,  Federal  Publications,  pp.  l'^r=Y5 . 
T9B27 — 

8.  Nash,  R-  C.  and  Cibinic,  J.,  Administration  of 
Government  Contracts,  The  George  !Tas"Eirigton 
University,    l^^l. 

9.  Whitesell,  C.  H.,  "Techniques  of  Negotiating  Eguitable 
Adjustments  Under  Government  Construction  Contracts." 
Changes  and  Changed  Conditions:  Government  Contracts 
T^onoqrapE  TIo.  3,  FeHeraT"  Publications,  pp.  3 y- 4 y , 
T^BTT — 

10.  Naval  Facilities  Engineering  Command,  Fiscal  Year  1 984 
Ccmmand    Management   Plan,    19  83. 

11.  Defense  Audit  Service  Report  82-133,  £§.£2^1  2R  "the 
Audit  of  Construction  Contract  Change  Orgers,  "73 
lugust  T'?82. 

12.  Naval  Facilities  Engineering  Command,  NAVFAC 
Contracting  Manual,  Publication  £^6  8,  January  iy7"9 
"(incT.~CiaangesJ. 


86 


13.  Jones,  R.  R.,  Inordinate  Use  of  Caanqe  Orders  in 
Military  Construction  ^onTrac^ls,  "STudent  "Report, 
leadersnip  an'd  i-lana  qemenT  Uevelopment  Center,  Air 
University,    U.S.    Air    force^    1963. 


14. 


Adrian,  J.  J. ^  Construction  Estimatinq:  An  Accounting 
and  Productivity  Ipproac'H,  Reslon  PuBlisEIng  Company, 
79B27 


15.  Park,  W.  R.,  The  Strategy  2^  Contracting  For  Profit, 
Prentice    Hall    Inc.,    T'^'EZ . 

16.  Kuhlman,  J.  M.  and  Johnson,  S.  R.,  "The  Number  of 
Ccmpetit ors  and  Bid  Prices,"  Southern  Economic 
J2^Ik§^t    V.    50,    pp.    213-220,    July    I^FTT  ~ 

17.  Oppenheimer,  S.  P.,  Directing  Construction  For  Profit, 
McGraw-Hill    Bock   Company,    T^7l. 

18.  Carr,  R.  I.,  "Paying  the  Price  for  Construction  Risk," 
Journal  of  the  Construction  Division,  Proceedings  of 
fHe  luerican  SocieTy  ox  Civil~Eng.ineers,  v.  T"D3,  pp. 
133-T^T7~HafcIi"l?777 

19.  Enqeltirecht-Wiggans,  R.  ,  "Auctions  and  Bidding  ."lodels: 
A  survey,"  Management  Science,  v.  26,  pp.  119-142, 
Fetruary    19Hn. 

20.  "Wrestling  with  Runaway  Bidding,"  Engineering-News 
Record,    V.    210,    p.    70,    23   June    1983. 

21.  Dougherty,  E.  L.  and  Lohrenz.  J.,  "Statistical 
Analyses  of  Bids  for  Federal  Offshore  Leases,"  Journal 
of  Petroleum  Technology,  v.  28,  pp.  1377-13'9TJ, 
■November    TTTB". 

22.  Hchns,  H.  M. ,  "How  Can  I  Prevent  the  Dispute  From 
Happening?  How  Can  I  Talk  My  Way  Out  of  Trouble  at 
the  Job  Site?,"  Avoiding  Liauility  in  Architecture, 
Design  and  ConstrucTi  en,  pp.  3U5-314,  JoHn  Tviley  and 
^ons,    17H3. 


23.         Sarkisian,      S.     _    S.,       "Contractor's    Viewpoint      of    Navy 
Constru 
Navy    Ci 
(1-11). 


Construction,"    Construction   Mana-gement     (text),       U.      Si 
Navy    Civil   Engineer  Corps~Df rlcer   3cTiool,       pp.       2812-8 


24.  Howell,  E.  B.  and  Howell,  R.  P.,  Untangling  the  Web  of 
Professional  Liability,  Design  Professionals  Insurance 
Co  mp  a  ny , ~T976  7 

25.  Vom  Baur,  F.  T. ,  "Differences  Between  Commercial 
Contracts  and . Government  Contracts,"  The  American  Bar 
Association  Journal,     1968. 


87 


26.  Eohertson.  J. ,  Seilinq  to  the  Federal  Government/ 
McGraw-Hill    Bock   Company,    TH7  97 

27.  Nash,  P.  C.  and  Cibinic,  J.,  Federal  Procurement  Law, 
Volume   II,    The   Georje    Washington   Qnlversity,    1"5'S15 . 

28.  rettit,  W.  F. ,  "Interpretation  of  Government 
Contracts:  The  Twelve  Rules,"  The  Government 
Contractor   Brieiin^  P  agers,    December    ^'^'E5. 

29.  Stokes,  M.,  Construction  Law  in  Contractor  *  s  Language, 
McGraw-Hill  BocI~Uompany,    1'97T7 


30.  The  Government  Contractor,  v.  22,  6  October  1980,  pp. 
"5-10. 

31.  The    Government    Contractor,    v.       19,    3    January    1977,    pp. 

32.  Nash,  E.  C.  and  Cibinic,  J.,  Federal  Procurement  Law, 
Volume   II,    The   George    Washington    UnlversITy,    1T77. 

33.  Federal    Acquisition    Regulation,    Volume    I,    Part    48. 

34.  Gilbreath,  E.  D. ,  Mana^in^  Construction  Contracts, 
John    Wiley   and    Sons,     1983. 

35.  Naval  Facilities  Engineering  Command,  Department  of 
the  Navy  Facilities  Category  Codes,  Publication  P-7"2, 
Harcl^"157T": 

36.  Eyan,  T.  A.,  Joiner,  B.  L.  and  Ryan,  B-  F. ,  Minitab 
Reference    ?1anual,    Duxbury   Press,    1981. 

37.  lenk,  B.  E.  ,  Government  Procurement  Policy:  A  Surve_y 
of  Strategies  an3'~Tec}iniuues,  TEe  ^orge  Washington 
Universiry7"T2   "Fay   T7777     


88 


IHIIIAL  DISTRIBOTION  LIST 


No.  Copies 


1.  Defense  Technical   Information   Center  2 
Cameron  Station 

Alexandria,    Virginia      223  14 

2.  litrary.    Code    0  142  2 
Naval    Postgraduate    School 

Monterey,    Califcrcia      93943 

3.  Defense  L0gist4.cs   Studies   Information    Exchange         1 
0.    S.    Army    Logistics   Management    Center 

Fort   Lee,    Virginia      23801 

4.  Department    Chairnan,    Code    54  1 
Department    of    Administrative   Science 

Naval    Postgraduate   School 
Monterey,    California      93943 

5.  Assistant    Professor   Dan   C.    Boger,    Code   54Bk  2 
Department    of    Administrative    science 

Naval    Postgraduate   School 
Monterey,    Califcrcia      93943 

6.  ICDE    William   B.    lalutis,    CEC,    QSN,    Code    54Tu  1 
Department    of    Administrative    Science 

Naval    Postgraduate    School 
Monterey,    Califcrnia      93943 

7.  Ccmmander  1 
Naval    Facilities   Engineering   Command 

200    Stcvall    Street 
Alexandria,    Virginia    22332 

8.  Mr.    J.    M.    Cowden,    Code    09N  1 
Naval    Facilities   Engineering   Command 

200    Stcvall    Street 
Alexandria,    Virginia    22332 

9.  Ccmmanding    Officer  2 
Western  Division 

Naval    Facilities   Engineering   Command 
San   Bruno,    California      94065 

10.  Ccmmanding    Officer  1 
Naval    School 

_  Civil    Engineer    Ccrps   Officers 
Port    Hueneme,    California      93043 

11.  LCD?    James    R.    Rosmond,    CEC,    USN  1 
Resident  Officer   in   Charge    of    Construction 
NAVFACFNGCOM    Contracts 

Andrews   Air   Force   Base 
Washington,    D.    C.      20331 


89 


13  5  3  7       5 


210579 


Thesis 

RTT17 
c.l 


Rosmond 

Analysis   of  low  bid- 
ding and  change  order  fl 
rates   for  Navy  facili- 
ties  construction  con- 
tracts. 


27   Ai:^  ^6 
23  DEC 
IS  WAR 


Thesis 

RTTIT 

c.l 


21C579 


Rosmond 

Analysis   of  low  bid- 
ding and  change  order 
rates   for  Navy   facili- 
ties  construction  con- 
tracts. 


